-- Logs begin at Mon 2022-10-17 02:34:04 UTC, end at Mon 2022-10-17 03:29:14 UTC. -- Oct 17 02:58:05.527660 dv-cinder-846977-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 17 02:58:05.536102 dv-cinder-846977-2-smb devstack@keystone.service[81593]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 02:58:05 2022] *** Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: nodename: dv-cinder-846977-2-smb Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: machine: x86_64 Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: clock source: unix Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: pcre jit disabled Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: detected number of CPU cores: 4 Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: current working directory: / Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: detected binary path: /usr/bin/uwsgi-core Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: your processes number limit is 47680 Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: your memory page size is 4096 bytes Oct 17 02:58:05.538106 dv-cinder-846977-2-smb devstack@keystone.service[81593]: detected max file descriptor number: 2048 Oct 17 02:58:05.538776 dv-cinder-846977-2-smb devstack@keystone.service[81593]: lock engine: pthread robust mutexes Oct 17 02:58:05.538776 dv-cinder-846977-2-smb devstack@keystone.service[81593]: thunder lock: enabled Oct 17 02:58:05.538776 dv-cinder-846977-2-smb devstack@keystone.service[81593]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 17 02:58:05.538776 dv-cinder-846977-2-smb devstack@keystone.service[81593]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 02:58:05.577193 dv-cinder-846977-2-smb devstack@keystone.service[81593]: Python main interpreter initialized at 0x55a8aac5b9c0 Oct 17 02:58:05.577193 dv-cinder-846977-2-smb devstack@keystone.service[81593]: python threads support enabled Oct 17 02:58:05.577193 dv-cinder-846977-2-smb devstack@keystone.service[81593]: your server socket listen backlog is limited to 100 connections Oct 17 02:58:05.577193 dv-cinder-846977-2-smb devstack@keystone.service[81593]: your mercy for graceful operations on workers is 90 seconds Oct 17 02:58:05.577525 dv-cinder-846977-2-smb devstack@keystone.service[81593]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 02:58:05.577604 dv-cinder-846977-2-smb devstack@keystone.service[81593]: *** Operational MODE: preforking *** Oct 17 02:58:05.577863 dv-cinder-846977-2-smb devstack@keystone.service[81593]: *** uWSGI is running in multiple interpreter mode *** Oct 17 02:58:05.577863 dv-cinder-846977-2-smb devstack@keystone.service[81593]: spawned uWSGI master process (pid: 81593) Oct 17 02:58:05.578050 dv-cinder-846977-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 17 02:58:05.579582 dv-cinder-846977-2-smb devstack@keystone.service[81593]: spawned uWSGI worker 1 (pid: 81603, cores: 1) Oct 17 02:58:05.579582 dv-cinder-846977-2-smb devstack@keystone.service[81593]: spawned uWSGI worker 2 (pid: 81604, cores: 1) Oct 17 02:58:05.579582 dv-cinder-846977-2-smb devstack@keystone.service[81593]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 02:58:09.806863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 02:58:09.806863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Oct 17 02:58:09.807674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 02:58:09.807674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: from cryptography.utils import int_from_bytes Oct 17 02:58:09.808138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 02:58:09.808138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Oct 17 02:58:09.808243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 02:58:09.808243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: from cryptography.utils import int_from_bytes Oct 17 02:58:09.856424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 02:58:09.856615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 02:58:09.856807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] command line args: [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 02:58:09.856904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 02:58:09.857076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 02:58:09.857162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 02:58:09.857241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ================================================================================ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 02:58:09.857324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] command line args: [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 02:58:09.857487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.857574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 02:58:09.857698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ================================================================================ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 02:58:09.857782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_dir = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.857903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.857989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] admin_token = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_source = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] config_dir = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] debug = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] config_source = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] debug = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.858948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_config_append = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.859929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_dir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_config_append = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_dir = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.860925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.861984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.862993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.863147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.863276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.863383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.863470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.863637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.863721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.864172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.864409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.864534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.864611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] publish_errors = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.864807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.864926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] publish_errors = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.865927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] standard_threads = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.866006 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.866659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.866745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.866913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] standard_threads = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_journal = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_json = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_stderr = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_syslog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] use_journal = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.867956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] use_json = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.868026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.868104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] use_stderr = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.868233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.868319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] use_syslog = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.868470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.868554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 02:58:09.868728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.868814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.868966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.869933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.870974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.871950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.872919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.873891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874133 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.874981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.875928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.876978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.877889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.878948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.879983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.880913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.881774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.882439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.882521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.882591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.882777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.882858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.883947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.884996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885869 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.885947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.886936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.887976 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.888997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.889974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.890902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.891986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.892924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.893968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.external = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.external = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.894959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.password = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.token = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.password = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.895846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.token = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.896971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.897990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.898949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.899933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900540 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.900950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.901977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.902926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.903924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904145 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.904854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905776 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.905941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.906932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.907944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.908908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.909978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.910933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.911994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.912922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.913900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.914929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.915905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.916839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.917965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.918967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.919966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.920898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.921979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.922924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.923962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.924903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.925850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.926966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.927911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.928008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] role.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.928160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.928241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] role.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.928391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.928470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.928637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.929968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.930924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.931989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.932961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.933925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934240 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.934916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.935085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.935187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.935321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.940743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.940743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.940902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.940995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.941958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.942928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.943964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.944931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.945943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.946953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 02:58:09.947385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 02:58:09.947445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 02:58:09.974832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.974970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.975059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.975138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.975282 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.975370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.984169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:09.984265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.012667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.012900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.012975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.013208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.066850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.067085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.115371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.115603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.116396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.116635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.271326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.271586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.271722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.271855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.272873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.295504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.295736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.295991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.296211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.296426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.296637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.296765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.296897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.297039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.297171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.297362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.297591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.297810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.298029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.308013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.308337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.320672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.320866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.321096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.321324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.321541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.321756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.321968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.322191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.322432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.322664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.322892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.323117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.323339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.323561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 17 02:58:10.338888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.339078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.339164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 02:58:10.339291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 02:58:10.339422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.339622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 02:58:10.339705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.339824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 17 02:58:10.339926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.340914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.350150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.350430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.350513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.350752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.350923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.351020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.351199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.351486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.357954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.358487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.360843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.361129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.361401 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.361484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.361681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.361763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.361963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.362838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.363026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.363106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.363297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.363380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.363562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.363644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.364107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.364387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.386767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.387418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.388241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.388528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.388914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.389204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.393155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.393441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.393724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.393927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.394214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.394497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.400553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.400835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.401406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.401697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.406362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.406660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.406959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.407236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.407318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.407513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.407597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.407788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.407891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.408085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.408180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.408357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.408439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.408678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.408951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.409224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.423769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.424073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.424694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.424975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.427887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.429359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.431615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.431942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.432592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.432892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.436153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.437100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.439266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.440387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.442492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.442794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.443081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.443369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.443602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.443684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.443928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.444014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.444218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.444569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.444849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.445131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.459584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.459898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.460683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.460947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.461422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.461713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.461983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.462251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.467759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.469092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.469325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.470629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.470849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.471166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.472178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.472466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.473798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.474084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.474365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.474647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.475045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.475136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.475372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.475704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.476021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.476422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.486191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.486476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.486753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.487030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.487405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.487500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.487696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.487780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.488004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.488092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.488353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.488735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.489269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.489550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.504012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.505409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.506966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.508452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.509908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.511336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.511474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.512817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.512905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.513114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.513522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.514270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.514558 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.514964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.519821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.521289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.521373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.523327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.524704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.525102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.525390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.525669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.526208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.526603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.526893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.527177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.533405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.533704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.533987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.534969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.535271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.535554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.540900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.541187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.541470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.541756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.542031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.542314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.542503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 17 02:58:10.542594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.542790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.542875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.543923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.544010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.544203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.544285 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.544472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.544554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.544741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.545020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.545299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.545572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.545878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.546194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 17 02:58:10.578632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8aac5b9c0 pid: 81603 (default app) Oct 17 02:58:10.580347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a8aac5b9c0 pid: 81604 (default app) Oct 17 02:58:10.581841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23a9-3f3a-4bd2-be8b-0509a3da56c4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:10.582126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23a9-3f3a-4bd2-be8b-0509a3da56c4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:10.582397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23a9-3f3a-4bd2-be8b-0509a3da56c4 None None] PATH_INFO: `/v3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:10.587094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Mon Oct 17 02:58:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:17.277853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:17.278337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:17.278438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:17.282653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:17.287968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:17.288989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:17.289126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:17.357930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: INFO dbcounter [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] Registered counter for database keystone Oct 17 02:58:17.376591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG oslo_db.sqlalchemy.engines [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 02:58:17.382715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writer thread running {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 02:58:17.560386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81603) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 17 02:58:17.560705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81603) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 17 02:58:17.621281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:17.623183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:17.749518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 02:58:18.200362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:18.268801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: INFO dbcounter [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] Registered counter for database keystone Oct 17 02:58:18.289949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG oslo_db.sqlalchemy.engines [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 02:58:18.295969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writer thread running {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 02:58:18.416083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb9426-4ac4-45d2-a10f-e6cb3d02f48f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:18.420328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:18.420947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:18.421228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:18.421499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:18.429612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:18.480461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 17 02:58:18.480813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a3039-8305-44c7-86e7-93c5150b851d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:18.490545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Oct 17 02:58:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 02:58:18.496691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:18.513889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8ed2-0690-4f7b-8770-386deda3a742 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:18.518295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:18.519441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:18.519680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:18.520248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] PATH_INFO: `/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:18.521854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee3c4f2dfdc417cadc7f4d4979df81a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:18.574667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING keystone.common.rbac_enforcer.enforcer [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 17 02:58:18.575018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb06947-a4c4-4651-b76c-991564268ee9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:18.579497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Oct 17 02:58:18 2022] GET /identity/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:20.682611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791d83-ef47-408c-9d44-a56ec6ccd272 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:20.683162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791d83-ef47-408c-9d44-a56ec6ccd272 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:20.683162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76791d83-ef47-408c-9d44-a56ec6ccd272 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:20.687261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:20.692580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:20.692989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:20.693120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:20.713771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:20.715254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:20.722846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 02:58:20.989669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791d83-ef47-408c-9d44-a56ec6ccd272 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:21.001792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76791d83-ef47-408c-9d44-a56ec6ccd272 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:21.006000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b64582-73bb-4f40-aa13-4ff6e746cc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:21.006600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b64582-73bb-4f40-aa13-4ff6e746cc19 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:21.006882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b64582-73bb-4f40-aa13-4ff6e746cc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:21.007181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b64582-73bb-4f40-aa13-4ff6e746cc19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:21.014778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b64582-73bb-4f40-aa13-4ff6e746cc19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:21.016571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b64582-73bb-4f40-aa13-4ff6e746cc19 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:21.025743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Mon Oct 17 02:58:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 02:58:21.031037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:21.040659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f01a94-44b1-4af4-9157-27220db29d7d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:21.045152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9492f9-2be9-4421-99be-0df3aa8df65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:21.045776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9492f9-2be9-4421-99be-0df3aa8df65a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:21.046055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9492f9-2be9-4421-99be-0df3aa8df65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:21.046324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9492f9-2be9-4421-99be-0df3aa8df65a admin admin] PATH_INFO: `/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:21.047609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9492f9-2be9-4421-99be-0df3aa8df65a admin admin] RBAC: Authorizing `identity:get_user(user_id=b3a2e1a16eeb43688a0405b1a0339b4f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:21.049448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9492f9-2be9-4421-99be-0df3aa8df65a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:21.050948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Mon Oct 17 02:58:21 2022] GET /identity/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:23.231733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d8694-e655-4093-92bf-85c0bc6ca9d2 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.232275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d8694-e655-4093-92bf-85c0bc6ca9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.232275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d8694-e655-4093-92bf-85c0bc6ca9d2 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.233576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:23.238669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.239049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.239335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.258379 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:23.259556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:23.263804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c804f-8c0f-4f31-bc89-78c870f551f2 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.264113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c804f-8c0f-4f31-bc89-78c870f551f2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.264391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c804f-8c0f-4f31-bc89-78c870f551f2 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.265695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:23.270911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.271199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.271471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.313031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG passlib.handlers.bcrypt [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81604) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 17 02:58:23.313434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG passlib.handlers.bcrypt [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81604) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 17 02:58:23.339741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:23.362166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:23.363748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:23.461527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:58:23.607407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:23.632952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:23.711357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab594fdd-ec34-4d3d-a6d7-c2b1dcd349f3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:23.725875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:23.745233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:23.745872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.746177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.746445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.757931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:23.766667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:23.767626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:23.768493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:58:23.773992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:23.824425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208a288-6fb7-4c29-ac0b-c9928de03d56 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:23.827341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:23.854500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:23.863139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:23.863981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.864270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.864817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.865794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:23.867801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:23.873266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcce28-c70c-4636-bec1-bab30eb39f41 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:23.878746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.sql.core [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 02:58:23.878746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 02:58:23.878746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [parameters: {'id': '5ab610b6b756478f984e671fb7146365', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 02:58:23.878746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81604) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application conn.query(q) Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 02:58:23.897131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result.read() Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 02:58:23.898556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application next(self.gen) Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application yield resource Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application next(self.gen) Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise self.value Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application session.commit() Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 02:58:23.899492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.session.flush() Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application compat.raise_( Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 02:58:23.900554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 02:58:23.901588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application conn.query(q) Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result.read() Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 02:58:23.902580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [parameters: {'id': '5ab610b6b756478f984e671fb7146365', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 02:58:23.903738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:23.904945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 8/15] 10.222.0.20 () {60 vars in 1137 bytes} [Mon Oct 17 02:58:23 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:58:23.906050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:23.908057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:23.908668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:23.908949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:23.909222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:23.909888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:23.910189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:23.911561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:23.923826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:23.929419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:24.006409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09e8c3-074d-49bc-8835-3a77c2457edf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:24.028474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9c7ed-dc77-462e-90e7-ba4e90549f18 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:24.039931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:24.040792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:24.041076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:24.041347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:24.059271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:24.060774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:24.061809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:24.062443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:24.062726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:24.063002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] PATH_INFO: `/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:24.064185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] RBAC: Authorizing `identity:get_user(user_id=b3a2e1a16eeb43688a0405b1a0339b4f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:24.065636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:24.067366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:23 2022] GET /identity/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:24.073288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:58:24.077057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:24.077899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:58:24.078754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:58:24.078754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:58:24.078754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:24.078754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:58:24.083630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:24.087921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:24.106393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:24.173563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e6c112-3961-4e35-a7c5-75acfcf3fedc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:24.185792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7361-2b4f-41c2-8ca7-3c0569fa0e0a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:24.207007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:24.207638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:24.207947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:24.208223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:24.209320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:24.210789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:24.212541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:24.217817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:24.222212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:24.222814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:24.223095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:24.223365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:24.224048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:24.224348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:24.226284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1227d6-216f-4408-9203-3fa71405bd39 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:24.244321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:24.301847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:24.322652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990350c2-bd54-4212-9124-3743ee670de4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:24.357954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c16e38-1ce1-4c06-9d60-537c41563ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:24.358923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16e38-1ce1-4c06-9d60-537c41563ae7 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:24.359212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16e38-1ce1-4c06-9d60-537c41563ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:24.359494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c16e38-1ce1-4c06-9d60-537c41563ae7 None admin] PATH_INFO: `/v3/domains/default/users/b3a2e1a16eeb43688a0405b1a0339b4f/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:24.361535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c16e38-1ce1-4c06-9d60-537c41563ae7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b3a2e1a16eeb43688a0405b1a0339b4f, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:24.363006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c16e38-1ce1-4c06-9d60-537c41563ae7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:24.478168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 11/21] 10.222.0.20 () {58 vars in 1361 bytes} [Mon Oct 17 02:58:24 2022] PUT /identity/v3/domains/default/users/b3a2e1a16eeb43688a0405b1a0339b4f/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 02:58:26.786461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ad405-0f25-4585-871b-879421eeec18 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:26.786965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ad405-0f25-4585-871b-879421eeec18 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:26.787061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ad405-0f25-4585-871b-879421eeec18 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:26.789037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:26.806456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5652a3-16a4-4294-bd37-ba3836f0009d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:26.806938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5652a3-16a4-4294-bd37-ba3836f0009d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:26.807029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5652a3-16a4-4294-bd37-ba3836f0009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:26.837003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ff5652a3-16a4-4294-bd37-ba3836f0009d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:26.838538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ff5652a3-16a4-4294-bd37-ba3836f0009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:26.847266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac58cc-f277-438e-95b1-48c7f7f976bb None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:26.847544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac58cc-f277-438e-95b1-48c7f7f976bb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:26.847829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac58cc-f277-438e-95b1-48c7f7f976bb None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:26.849442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 12/23] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:26.855110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838accb7-75d3-4b9c-a4ae-754962b0b97c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:26.855655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838accb7-75d3-4b9c-a4ae-754962b0b97c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:26.856161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838accb7-75d3-4b9c-a4ae-754962b0b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:26.892912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-838accb7-75d3-4b9c-a4ae-754962b0b97c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:26.894443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-838accb7-75d3-4b9c-a4ae-754962b0b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:26.942081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 12/24] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:27.033332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:27.186511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac179f5-292e-47ea-88d5-374a8458148d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:27.186812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac179f5-292e-47ea-88d5-374a8458148d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:27.186996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac179f5-292e-47ea-88d5-374a8458148d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:27.191378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:27.205785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e156ab3-90f5-45eb-afe5-7b117926e32a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:27.206082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e156ab3-90f5-45eb-afe5-7b117926e32a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:27.206284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e156ab3-90f5-45eb-afe5-7b117926e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:27.233063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2e156ab3-90f5-45eb-afe5-7b117926e32a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:27.234267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2e156ab3-90f5-45eb-afe5-7b117926e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:27.237468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:27.318157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:27.397375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe229e-26dd-4ddc-988a-6ea946f5e98a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:27.397768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe229e-26dd-4ddc-988a-6ea946f5e98a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:27.397992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe229e-26dd-4ddc-988a-6ea946f5e98a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:27.399340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 14/28] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:27.404779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:27.405070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:27.405342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:27.437239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:27.438347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:27.465340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe229e-26dd-4ddc-988a-6ea946f5e98a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:27.545688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:58:27.587464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:27.599304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:27.662386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe229e-26dd-4ddc-988a-6ea946f5e98a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:27.714872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:27.732574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:27.733210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:27.733497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:27.733772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:27.734453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:27.735988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:27.757658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 15/30] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Oct 17 02:58:27 2022] POST /identity/v3/roles => generated 219 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:58:27.758860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:27.772084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3fc4a-5aff-4631-996f-0a5de93c7d93 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:27.851024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:27.854029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:27.854592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:27.856339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:27.880726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:27.883759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:58:27.918341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:27.919294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:58:27.920628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:58:27.920628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:58:27.920628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:27.922262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:58:27.923304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:27.988530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbf0a7-444c-4fbd-8406-4e6d81557099 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.028189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:28.037185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.039458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.039988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.040479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.054505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:28.062177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:28.063787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:28.065369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:28.070137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:28.070137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:28.118251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cffb8b-9ed6-4dde-b434-daf6608ff44d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.149361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:28.161883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.162497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.162779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.163046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.163765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:28.165202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:28.206480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72fe80-a587-4a6e-9f96-87b28e2db1a7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.245237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.246177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.246675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.247146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.248030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:28.248533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:28.250120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:28.269028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:28.270147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:28.298499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Oct 17 02:58:27 2022] POST /identity/v3/roles => generated 225 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:28.299273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:28.325870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:28.381474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12344f34-3a9c-431f-af21-8deee4fd3ef8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.432820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.435098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.435589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.436830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.437753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:28.439446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:28.443784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:28.463940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 18/35] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:28.468138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:28.522121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceae02-7744-4cbd-ad9d-71d15d89919e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.564642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714d15-bf2c-4023-bc3f-b97b11dc72a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.565340 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714d15-bf2c-4023-bc3f-b97b11dc72a3 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.565633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714d15-bf2c-4023-bc3f-b97b11dc72a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.565913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714d15-bf2c-4023-bc3f-b97b11dc72a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.566587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714d15-bf2c-4023-bc3f-b97b11dc72a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:28.568236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714d15-bf2c-4023-bc3f-b97b11dc72a3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:28.606325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:58:28 2022] POST /identity/v3/projects => generated 301 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:28.607797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7e823-7c0c-460a-a5de-7f61546aafaa None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.608136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7e823-7c0c-460a-a5de-7f61546aafaa None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.608482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7e823-7c0c-460a-a5de-7f61546aafaa None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.610347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 19/37] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:28.617959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a7b3-779d-446d-8c46-13c7725bcc50 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.618312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a7b3-779d-446d-8c46-13c7725bcc50 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.618510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a7b3-779d-446d-8c46-13c7725bcc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.644289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-90c9a7b3-779d-446d-8c46-13c7725bcc50 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:28.647279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-90c9a7b3-779d-446d-8c46-13c7725bcc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:28.694207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:28.738323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b26a8f-20e4-41ee-bdfd-c4631820b4f5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.747604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:28.747604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402a19b-3cbd-401c-b317-0228947e9001 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.747604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402a19b-3cbd-401c-b317-0228947e9001 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.747604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402a19b-3cbd-401c-b317-0228947e9001 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.747604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 21/39] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:28.753309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.753609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.754431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.759620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:28.778147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:28.779489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:28.784914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.785570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.785852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.786127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] PATH_INFO: `/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.787398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] RBAC: Authorizing `identity:get_user(user_id=b3a2e1a16eeb43688a0405b1a0339b4f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:28.789522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:28.791340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 19/40] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:28 2022] GET /identity/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f => generated 247 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:28.796872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:28.865454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:28.915409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25aa29-e722-4b41-a569-fe385c4cf02b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:28.953114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:28.953756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:28.954046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:28.954324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:28.955460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:28.958252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:28.958943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 20/42] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:28.964648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:29.034189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:29.059938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:29.068582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df91c4-2048-4c7d-a8f9-04eb07fd883a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:29.086387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:29.106528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:29.107132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:29.107413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:29.107684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:29.108467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.domain.id=default, user.id=b3a2e1a16eeb43688a0405b1a0339b4f) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:29.108770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:29.110184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:29.119783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 23/43] 10.222.0.20 () {56 vars in 1322 bytes} [Mon Oct 17 02:58:28 2022] GET /identity/v3/role_assignments?user.id=b3a2e1a16eeb43688a0405b1a0339b4f&scope.domain.id=default&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:29.143600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc21450-c3d4-4e6c-9b88-4feb0adfe3d8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:29.148029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:29.184472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:29.185100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:29.185386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:29.185781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:29.186600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:29.188079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:29.204972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Oct 17 02:58:29 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:58:29.264185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd903e50-666a-4d24-b9fd-aeafa0eff7f4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:29.305227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17af89d-ab24-48d8-8f01-79997004ef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:29.305819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17af89d-ab24-48d8-8f01-79997004ef1e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:29.306108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17af89d-ab24-48d8-8f01-79997004ef1e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:29.306433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17af89d-ab24-48d8-8f01-79997004ef1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:29.307659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17af89d-ab24-48d8-8f01-79997004ef1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:29.309198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17af89d-ab24-48d8-8f01-79997004ef1e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:29.310876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 24/45] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:29.317002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:29.426784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff472c1-dc43-446c-aa66-29e71fb8506b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:29.435680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:29.462480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010501be-4114-4c36-969d-290eb864cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:29.463089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010501be-4114-4c36-969d-290eb864cb64 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:29.463370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010501be-4114-4c36-969d-290eb864cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:29.463642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010501be-4114-4c36-969d-290eb864cb64 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:29.464345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010501be-4114-4c36-969d-290eb864cb64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:29.465788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010501be-4114-4c36-969d-290eb864cb64 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:29.493580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 22/46] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:58:29 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:58:31.601878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1c4dc-99fe-4e03-962e-ff195877af5b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:31.602395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1c4dc-99fe-4e03-962e-ff195877af5b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:31.602498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1c4dc-99fe-4e03-962e-ff195877af5b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:31.603759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:31.608926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:31.609349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:31.609433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:31.628101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:31.629278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:31.692348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:31.955341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1c4dc-99fe-4e03-962e-ff195877af5b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:31.983458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:32.055527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1c4dc-99fe-4e03-962e-ff195877af5b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:32.088236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd87cae-f14c-4245-a25a-ccaebed77af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:32.088858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87cae-f14c-4245-a25a-ccaebed77af8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:32.089146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87cae-f14c-4245-a25a-ccaebed77af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:32.089425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd87cae-f14c-4245-a25a-ccaebed77af8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:32.090536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87cae-f14c-4245-a25a-ccaebed77af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:32.092022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd87cae-f14c-4245-a25a-ccaebed77af8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:32.093661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 26/49] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:32.099441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:32.186034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:32.196850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba1e18-5fca-4ba2-abb5-99ac71a4501f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:32.229844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ad198-27de-4903-8e36-34702d961a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:32.230394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ad198-27de-4903-8e36-34702d961a91 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:32.230683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ad198-27de-4903-8e36-34702d961a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:32.230962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ad198-27de-4903-8e36-34702d961a91 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:32.231613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ad198-27de-4903-8e36-34702d961a91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:32.233088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ad198-27de-4903-8e36-34702d961a91 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:32.258241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 24/50] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Oct 17 02:58:32 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:34.375786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840f96f-3e73-421d-9f1b-ef4c771fa4c0 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:34.376348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840f96f-3e73-421d-9f1b-ef4c771fa4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:34.376497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840f96f-3e73-421d-9f1b-ef4c771fa4c0 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:34.377827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 27/51] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:34.382870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:34.383274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:34.383426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:34.401278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:34.402449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:34.467420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 25/52] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:34.733738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840f96f-3e73-421d-9f1b-ef4c771fa4c0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:34.824504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:34.832410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840f96f-3e73-421d-9f1b-ef4c771fa4c0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:34.865630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8c6d4-9704-4090-b142-1a2d110e1939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:34.866245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8c6d4-9704-4090-b142-1a2d110e1939 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:34.866599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8c6d4-9704-4090-b142-1a2d110e1939 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:34.866875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8c6d4-9704-4090-b142-1a2d110e1939 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:34.868009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8c6d4-9704-4090-b142-1a2d110e1939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:34.869468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8c6d4-9704-4090-b142-1a2d110e1939 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:34.871096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 28/53] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:34.876595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:34.944768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:34.975316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca025b-8330-4eb5-a8fc-88c9f3855ffe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:35.008440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df2fae-9e22-43a8-98d7-315cc2a487ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:35.009050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2fae-9e22-43a8-98d7-315cc2a487ab None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:35.009340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2fae-9e22-43a8-98d7-315cc2a487ab None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:35.009619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2fae-9e22-43a8-98d7-315cc2a487ab None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:35.010267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df2fae-9e22-43a8-98d7-315cc2a487ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:35.011728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df2fae-9e22-43a8-98d7-315cc2a487ab None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:35.038088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 26/54] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:58:34 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:38.211279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2125-d38d-4143-b496-eed14cfeb6b1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.212291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2125-d38d-4143-b496-eed14cfeb6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.212771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2125-d38d-4143-b496-eed14cfeb6b1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.214303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 29/55] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:38.220250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fbe7d-cd7e-4e37-8c11-4d1745fcb8a5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.221202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fbe7d-cd7e-4e37-8c11-4d1745fcb8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.221679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fbe7d-cd7e-4e37-8c11-4d1745fcb8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.249159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7f9fbe7d-cd7e-4e37-8c11-4d1745fcb8a5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:38.250769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7f9fbe7d-cd7e-4e37-8c11-4d1745fcb8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:38.335252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 27/56] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:38.389872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3efb56-a17a-47f6-8b08-7a19edcd9504 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.390499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3efb56-a17a-47f6-8b08-7a19edcd9504 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.390971 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3efb56-a17a-47f6-8b08-7a19edcd9504 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.392836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 30/57] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:38.398086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785512c-a9ca-47e3-9809-2bf375b39890 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.398592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785512c-a9ca-47e3-9809-2bf375b39890 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.399076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785512c-a9ca-47e3-9809-2bf375b39890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.414752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1e582-94af-4d65-968d-bbe0e9baa83c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.415344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1e582-94af-4d65-968d-bbe0e9baa83c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.415814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be1e582-94af-4d65-968d-bbe0e9baa83c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.417345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 31/58] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:38.422474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.422987 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.423490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.434053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f785512c-a9ca-47e3-9809-2bf375b39890 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:38.440125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f785512c-a9ca-47e3-9809-2bf375b39890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:38.453568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:38.454964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:38.541542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:38.565396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 32/59] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:58:38.581769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 28/60] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:38.711513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:38.807383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:38.816621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc73e6-f989-46db-9eb4-a7a38ae66afc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:38.822529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25efec-276c-4eed-8b4a-9a262d1f1d71 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.823116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25efec-276c-4eed-8b4a-9a262d1f1d71 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.823600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25efec-276c-4eed-8b4a-9a262d1f1d71 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.825258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 29/61] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:38.831082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.831695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.832199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.868689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:38.870323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:38.959316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 30/62] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:38.961717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:38.975613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:38.976456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:38.976746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:38.977035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:38.989337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:38.996512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:38.997378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:38.998164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 33/63] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:38.998826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.073607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5849f-59e1-484a-b358-b745feaa162a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.091724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.112025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.112898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.113177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.113465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.126333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe3018-2de2-463f-88cd-ce0da2cc2799 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.128390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:39.135300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:39.136274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:39.137056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 31/64] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:58:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:39.141483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.175096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.176798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.177290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.178038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.193254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:39.200823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:39.201680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:39.202434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:39.205648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 34/65] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:39.207144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.226537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.270073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882702a-f8d2-49d1-ad98-fe52bb326bf7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.306263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.306873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.307164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.307442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.308146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:39.308455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.309850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.316480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed299a79-3861-40bc-aa0c-b68230a9221e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.317781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 32/66] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.318573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.354678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.355207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.355493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.355772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.356464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:39.356771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.358166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a3549-a224-41fc-aef4-4c72fe985f4d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.360372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.370581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 35/67] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.371763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac72d-82a7-4d78-a34f-a25b620aec9f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.372083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac72d-82a7-4d78-a34f-a25b620aec9f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.372365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac72d-82a7-4d78-a34f-a25b620aec9f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.373597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 36/68] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:39.374289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac72d-82a7-4d78-a34f-a25b620aec9f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.423291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be835fb-ed38-4418-a74b-9626559047f7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.448337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.457157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.457771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.458058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.458343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.459002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:39.459307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.460848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.468978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 33/69] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.469767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.478206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac72d-82a7-4d78-a34f-a25b620aec9f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.511914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.512542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.512828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.513104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.523743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:39.528629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:39.529493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:39.530293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 37/70] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:39.530933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.570344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff06b98-6e9c-4f57-860f-f46c1265891d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.571995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.605441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86043c15-99dc-43a9-9bbd-1881c3464899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.606001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043c15-99dc-43a9-9bbd-1881c3464899 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.606286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043c15-99dc-43a9-9bbd-1881c3464899 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.606560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86043c15-99dc-43a9-9bbd-1881c3464899 None admin] PATH_INFO: `/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.607707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86043c15-99dc-43a9-9bbd-1881c3464899 None admin] RBAC: Authorizing `identity:get_user(user_id=b3a2e1a16eeb43688a0405b1a0339b4f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.609176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86043c15-99dc-43a9-9bbd-1881c3464899 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.610944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 34/71] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.612014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.612301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.612580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.629908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:39.631097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:39.636605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b808da-b247-4834-b6f7-1434af3b0eaa None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.669736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.670366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.670650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.670925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] PATH_INFO: `/v3/users/756f4309353f49bda9534cdd99dbb397` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.672845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.686969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] RBAC: Authorizing `identity:get_user(user_id=756f4309353f49bda9534cdd99dbb397)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.688466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.690079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 38/72] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/users/756f4309353f49bda9534cdd99dbb397 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.690844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.700119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 35/73] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:39.700954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.793364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3f40-ad04-44ee-be90-1badca8d7117 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.817070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.820844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec8978-a614-4125-a233-8072b44ec4e0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.830096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.831405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.831701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.832383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] PATH_INFO: `/v3/users/756f4309353f49bda9534cdd99dbb397` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.833875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] RBAC: Authorizing `identity:get_user(user_id=756f4309353f49bda9534cdd99dbb397)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.835356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.837043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 39/74] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/users/756f4309353f49bda9534cdd99dbb397 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.837822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.859122 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.859661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.859973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.860254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.860914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:39.861224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.862613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.875214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 36/75] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.875214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:39.908308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:39.958008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb36f1-0c28-41ab-8a45-ae2d6d2c1979 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.981593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552196d-99b9-45f5-a98b-2f1f2413a860 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:39.992675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:39.993338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:39.993625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:39.993903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:39.995037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:39.996526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:39.998163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:39.998924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.019825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.020479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.020762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.021041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.022184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.024182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.025800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 37/77] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:40.030501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.056711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:40.106363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d119f8-d341-429c-85dc-61b52b6dff61 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.127255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a7f6-ee06-4e67-b0c8-cc0e3dd01d27 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.133477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:40.141681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.142312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.142605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.142882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.144039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.145506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.147319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 41/78] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:39 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:40.148453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.166086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.166717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.167002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.167279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] PATH_INFO: `/v3/users/756f4309353f49bda9534cdd99dbb397` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.168449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] RBAC: Authorizing `identity:get_user(user_id=756f4309353f49bda9534cdd99dbb397)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.169895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.171492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 38/79] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:40 2022] GET /identity/v3/users/756f4309353f49bda9534cdd99dbb397 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:40.172258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.250207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824362ab-4b81-425b-a0ae-0325e0eb7575 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.268108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:40.271817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a822a-25c7-40fd-b375-81b13ca969f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.283114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.283738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.284057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.284337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.285451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.286895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.289498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 42/80] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:40.292030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.307853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.308534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.308813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.309093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/b3a2e1a16eeb43688a0405b1a0339b4f/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.310971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] RBAC: Authorizing `identity:create_grant(project_id=f62a2c2b9817413184cb7c2cc540ae13, user_id=b3a2e1a16eeb43688a0405b1a0339b4f, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.312447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.324325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 39/81] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:40 2022] PUT /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/b3a2e1a16eeb43688a0405b1a0339b4f/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:40.325112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.358663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:40.405701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18d905-958b-4aaa-9d73-bc4e60c5200c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.447886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.448973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.449258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.449537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/756f4309353f49bda9534cdd99dbb397/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.451248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f5cc-c97f-4a68-8299-1d0c73281f1e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.451924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f62a2c2b9817413184cb7c2cc540ae13, user_id=756f4309353f49bda9534cdd99dbb397, role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.453419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.476342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 43/82] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:40 2022] PUT /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/756f4309353f49bda9534cdd99dbb397/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:40.476342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.515277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.516005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.516292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.516570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/756f4309353f49bda9534cdd99dbb397/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.519329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] RBAC: Authorizing `identity:create_grant(project_id=f62a2c2b9817413184cb7c2cc540ae13, user_id=756f4309353f49bda9534cdd99dbb397, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.521080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.537021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 40/83] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:40 2022] PUT /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/756f4309353f49bda9534cdd99dbb397/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:40.543399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.581598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:40.618151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788529ee-01a2-458b-b49a-bdec32d05ae5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.662275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:40.688158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.688898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.689190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.689476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] PATH_INFO: `/v3/projects/88cdcef515394829ae6ee1de99e76599` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.693118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] RBAC: Authorizing `identity:get_project(project_id=88cdcef515394829ae6ee1de99e76599)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.695196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.708565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 44/84] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:40 2022] GET /identity/v3/projects/88cdcef515394829ae6ee1de99e76599 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:40.714894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:40.731415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b2a34-ebf9-4855-9ce5-0ce9b48b4a14 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.777337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c9a62-f667-474c-9110-a9252c79a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.777966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9a62-f667-474c-9110-a9252c79a433 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.778301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9a62-f667-474c-9110-a9252c79a433 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.778588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c9a62-f667-474c-9110-a9252c79a433 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.780635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c9a62-f667-474c-9110-a9252c79a433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.781445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c9a62-f667-474c-9110-a9252c79a433 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.820062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 41/85] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:58:40 2022] POST /identity/v3/users => generated 289 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:40.858243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e21219-e015-4da2-89db-bc984b4a93c9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:40.897602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f4616-3348-4cf9-942a-6db048b16b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:40.898673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4616-3348-4cf9-942a-6db048b16b68 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:40.899188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4616-3348-4cf9-942a-6db048b16b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:40.899684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f4616-3348-4cf9-942a-6db048b16b68 None admin] PATH_INFO: `/v3/projects/88cdcef515394829ae6ee1de99e76599/users/756f4309353f49bda9534cdd99dbb397/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:40.902190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f4616-3348-4cf9-942a-6db048b16b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=88cdcef515394829ae6ee1de99e76599, user_id=756f4309353f49bda9534cdd99dbb397, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:40.904056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f4616-3348-4cf9-942a-6db048b16b68 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:40.922701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 45/86] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:40 2022] PUT /identity/v3/projects/88cdcef515394829ae6ee1de99e76599/users/756f4309353f49bda9534cdd99dbb397/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:43.027394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923198ce-7ff1-4b43-9db7-a03263d7759b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.027914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923198ce-7ff1-4b43-9db7-a03263d7759b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.027991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923198ce-7ff1-4b43-9db7-a03263d7759b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.029371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 42/87] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:43.034677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181583da-28e5-414c-87c2-35d2a3b69770 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.035464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181583da-28e5-414c-87c2-35d2a3b69770 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.035975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181583da-28e5-414c-87c2-35d2a3b69770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.060918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-181583da-28e5-414c-87c2-35d2a3b69770 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:43.062129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-181583da-28e5-414c-87c2-35d2a3b69770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:43.098123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82c7a-16f0-4d18-966d-909849379dd9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.098404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82c7a-16f0-4d18-966d-909849379dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.098685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82c7a-16f0-4d18-966d-909849379dd9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.100279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 43/88] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:43.106596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b05b-45d9-422b-8d9a-841c35fb4758 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.106890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b05b-45d9-422b-8d9a-841c35fb4758 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.107234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7b05b-45d9-422b-8d9a-841c35fb4758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.123598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:43.142646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b1a7b05b-45d9-422b-8d9a-841c35fb4758 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:43.143858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b1a7b05b-45d9-422b-8d9a-841c35fb4758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:43.154172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 46/89] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:43.246173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 44/90] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 17 02:58:43.544351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53bfc7-4782-4144-b658-76e184ec4a60 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.545002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53bfc7-4782-4144-b658-76e184ec4a60 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.545495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53bfc7-4782-4144-b658-76e184ec4a60 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.547155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 47/91] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:43.565304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.565596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.565881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.578601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:43.592758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:43.593872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53bfc7-4782-4144-b658-76e184ec4a60 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:43.594022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:43.676054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 45/92] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:43.744552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53bfc7-4782-4144-b658-76e184ec4a60 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:43.767555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:43.791495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:43.792497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.792985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.793461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.817086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:43.822838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:43.823690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:43.824495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:43.832398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:43.843900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:43.938028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b826-9c90-422f-b72c-7ee3590a6669 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:43.944014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:43.991658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:43.992329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:43.992611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:43.992890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:43.994787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.024917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:44.029822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:44.031110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:44.031866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 46/94] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:58:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:44.044862 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.081034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a551509-9eea-4177-a5f0-8e768a021189 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.139045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.139656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.139979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.140257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.140921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:44.141703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.143106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.155015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 49/95] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:44.155738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.281832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bef22d-563b-495d-9f17-4d599899b7b5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.283026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97a5a8-628e-4169-8279-c226aa50cbb6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.285683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.323086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.323774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.324097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.324374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.324726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947de3d-dc5c-44ae-b132-8d5b65c9746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.325040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:44.325345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.325968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947de3d-dc5c-44ae-b132-8d5b65c9746e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.326503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947de3d-dc5c-44ae-b132-8d5b65c9746e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.326795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.327193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947de3d-dc5c-44ae-b132-8d5b65c9746e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.337852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:44.338607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.340873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947de3d-dc5c-44ae-b132-8d5b65c9746e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8947de3d-dc5c-44ae-b132-8d5b65c9746e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:44.346847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:44.347714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:44.348527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:44.351176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:44.352592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ceb3ff-4098-4b9e-a0bc-4444e4604e8d None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.353080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ceb3ff-4098-4b9e-a0bc-4444e4604e8d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.353566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ceb3ff-4098-4b9e-a0bc-4444e4604e8d None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.355731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:44.356975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ceb3ff-4098-4b9e-a0bc-4444e4604e8d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.413264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.477170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ceb3ff-4098-4b9e-a0bc-4444e4604e8d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.478099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc47901-0427-471c-ac1f-a3e104187649 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.519354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.520048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.520334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.520611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] PATH_INFO: `/v3/users/756f4309353f49bda9534cdd99dbb397` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.521773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] RBAC: Authorizing `identity:get_user(user_id=756f4309353f49bda9534cdd99dbb397)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.523331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.525299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 52/99] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/users/756f4309353f49bda9534cdd99dbb397 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:44.526189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.539895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70109811-e78a-4ced-8879-1a66a1115081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.539895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70109811-e78a-4ced-8879-1a66a1115081 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.539895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70109811-e78a-4ced-8879-1a66a1115081 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.539895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70109811-e78a-4ced-8879-1a66a1115081 None admin] PATH_INFO: `/v3/users/756f4309353f49bda9534cdd99dbb397` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.540258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70109811-e78a-4ced-8879-1a66a1115081 None admin] RBAC: Authorizing `identity:get_user(user_id=756f4309353f49bda9534cdd99dbb397)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.540258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70109811-e78a-4ced-8879-1a66a1115081 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.542121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 48/100] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/users/756f4309353f49bda9534cdd99dbb397 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:44.544070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.544361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.544638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.566458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.568720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:44.570632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:44.639724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173647c-b952-4402-8f29-a2cdda2eb79f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.651456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:44.652343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.673920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.674516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.674796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.675072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.675719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:44.676059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.677428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.686626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:44.691965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:44.709395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.756753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26943d1-7620-47bb-a5a8-541b143bfbd6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.787592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.793955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e18d2-86cd-4933-ac79-c3f5c0188cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.794765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e18d2-86cd-4933-ac79-c3f5c0188cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.795146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c72d6-c37a-4a38-a4a6-4774dd7c7671 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:44.795393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e18d2-86cd-4933-ac79-c3f5c0188cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.795804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e18d2-86cd-4933-ac79-c3f5c0188cd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.829717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:44.830314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.830595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.830863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.862605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e18d2-86cd-4933-ac79-c3f5c0188cd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.864321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e18d2-86cd-4933-ac79-c3f5c0188cd3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.900239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:44.901647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:44.921253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:44.966279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 50/103] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:44.967535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c89de9-307e-4eed-93e8-1ab8c1e11749 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.967820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c89de9-307e-4eed-93e8-1ab8c1e11749 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.968126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c89de9-307e-4eed-93e8-1ab8c1e11749 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.969365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 51/104] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:44.972994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26d2d-02c7-4b70-ac37-dcad52faed73 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:44.973470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26d2d-02c7-4b70-ac37-dcad52faed73 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:44.973640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d26d2d-02c7-4b70-ac37-dcad52faed73 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:44.974874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 52/105] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:44.975569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26d2d-02c7-4b70-ac37-dcad52faed73 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.001979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.014167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 54/106] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:45.014167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.079085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d26d2d-02c7-4b70-ac37-dcad52faed73 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.107527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5467a6-8347-4575-97cd-bbca331579ed None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.112117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.112741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.113024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.113329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] PATH_INFO: `/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.114431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] RBAC: Authorizing `identity:get_user(user_id=b3a2e1a16eeb43688a0405b1a0339b4f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.116187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.117897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 53/107] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:44 2022] GET /identity/v3/users/b3a2e1a16eeb43688a0405b1a0339b4f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.118663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.141010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54219833-65a2-44bc-9e9e-23a2da7413bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.141636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219833-65a2-44bc-9e9e-23a2da7413bf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.141917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219833-65a2-44bc-9e9e-23a2da7413bf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.142190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54219833-65a2-44bc-9e9e-23a2da7413bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.143859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.152585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54219833-65a2-44bc-9e9e-23a2da7413bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-54219833-65a2-44bc-9e9e-23a2da7413bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:45.157247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:45.158137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:45.158937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 55/108] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:45.159573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25af89-0fb6-4a52-a719-c8720ad60fe8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.160145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25af89-0fb6-4a52-a719-c8720ad60fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.160145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25af89-0fb6-4a52-a719-c8720ad60fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.177719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-df25af89-0fb6-4a52-a719-c8720ad60fe8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:45.179058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-df25af89-0fb6-4a52-a719-c8720ad60fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:45.219008 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269f99a-389b-48a9-aadb-cac492eba50d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.226459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.245489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 56/109] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:45.246680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.246968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.247413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.257961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.258600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.258887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.259167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.260321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.261766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.268165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.268165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.275466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:45.276700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:45.347567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 57/111] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:45.348518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.370540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.380212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75e6f1-c8fe-4783-bbc7-bc139e691147 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.415704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.416435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.416870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.417206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.418422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.419997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.421895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.422732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.471178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05c3df-281f-4672-a410-3ea785c67298 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.488800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.515367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.516384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.516937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.517449 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.527643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422092f-63fa-49b9-b719-b141ac306000 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.562658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.563439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.563543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.563801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.564561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:45.564870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.566244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.574486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 56/113] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.575202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.595263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.596813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.597722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.676232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e8d8-818f-410d-8717-8c02d5304fa8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.697217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 58/114] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:45.698135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.711369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38040-7313-4586-9867-74c0f07094be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.712014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38040-7313-4586-9867-74c0f07094be None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.712294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38040-7313-4586-9867-74c0f07094be None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.712742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c38040-7313-4586-9867-74c0f07094be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.712859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.713281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38040-7313-4586-9867-74c0f07094be None admin] RBAC: Adding query filter params (role.id=82925f6f46954c11888eaaf2678ac2e1, scope.project.id=f62a2c2b9817413184cb7c2cc540ae13, user.id=756f4309353f49bda9534cdd99dbb397) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:45.713587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38040-7313-4586-9867-74c0f07094be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.715039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c38040-7313-4586-9867-74c0f07094be None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.721993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 57/115] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/role_assignments?user.id=756f4309353f49bda9534cdd99dbb397&scope.project.id=f62a2c2b9817413184cb7c2cc540ae13&role.id=82925f6f46954c11888eaaf2678ac2e1 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.722770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38040-7313-4586-9867-74c0f07094be None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.806273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb09b9-9bb9-4d41-9bfc-7eeae4cba08d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.817096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:45.834853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c38040-7313-4586-9867-74c0f07094be None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:45.844424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.845072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.845442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.846024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.846466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] RBAC: Adding query filter params (role.id=ab9c3b4062604fe89c73ebd5acc431c7, scope.project.id=f62a2c2b9817413184cb7c2cc540ae13, user.id=756f4309353f49bda9534cdd99dbb397) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:45.846773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.850115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.856756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 59/116] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/role_assignments?user.id=756f4309353f49bda9534cdd99dbb397&scope.project.id=f62a2c2b9817413184cb7c2cc540ae13&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.857459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.880893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:45.882054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:45.882484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:45.882902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:45.884521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:45.886313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:45.888304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 58/117] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:45.889572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:45.976191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.002844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd0d9-6987-489c-9e88-3896c7327325 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.020342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb318cf7-a49c-48d9-b0d7-c357b3ce5c89 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.045537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.046200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.046488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.046765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] PATH_INFO: `/v3/users/756f4309353f49bda9534cdd99dbb397` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.047983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] RBAC: Authorizing `identity:get_user(user_id=756f4309353f49bda9534cdd99dbb397)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.049467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.055557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 60/118] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/users/756f4309353f49bda9534cdd99dbb397 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:46.055557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.059111 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.059918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.060203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.060476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.072278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:46.077577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:46.078468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 59/119] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:46.079657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.096963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.176815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ff5ad-287c-4da5-9337-52a1a7695099 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.184058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a0dcc-086d-4581-8dc2-c2e245c636bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.211321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.212098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.212331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.212611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.213712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.215148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.216270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.216814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 61/120] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:46.217674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.220187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.220399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.220685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.221355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.223069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.234217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.249197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 60/121] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:58:46 2022] POST /identity/v3/projects => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:46.252853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.332842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.333942 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77222285-4c92-4f73-b64e-87252217f231 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.374702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.375348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.375621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.375916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.376096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdada719-0c0d-4c8c-b306-166ff368fb1d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.416891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a1770-d34d-4528-8524-5798f580533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.417679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a1770-d34d-4528-8524-5798f580533a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.417969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a1770-d34d-4528-8524-5798f580533a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.418248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a1770-d34d-4528-8524-5798f580533a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.418954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a1770-d34d-4528-8524-5798f580533a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:46.419272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a1770-d34d-4528-8524-5798f580533a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.420736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a1770-d34d-4528-8524-5798f580533a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.434818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 61/122] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:46.434818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a1770-d34d-4528-8524-5798f580533a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.455419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.456975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.473799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.540013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a1770-d34d-4528-8524-5798f580533a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.566467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:46.568213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.568738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.581386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.582003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.582290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.582570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.583338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=f62a2c2b9817413184cb7c2cc540ae13, user.id=b3a2e1a16eeb43688a0405b1a0339b4f) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:46.583649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.585679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.592003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/role_assignments?user.id=b3a2e1a16eeb43688a0405b1a0339b4f&scope.project.id=f62a2c2b9817413184cb7c2cc540ae13&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:46.592803 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.687244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bc578-c9ee-4d55-b384-fa56a61c7db3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.705324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.729501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.730567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.731002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.731293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] PATH_INFO: `/v3/users/389785b520e84ec995c40be927956f56` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.742314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc921-65d3-4829-a432-54798db6f73e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.748538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] RBAC: Authorizing `identity:get_user(user_id=389785b520e84ec995c40be927956f56)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.750160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.752420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/users/389785b520e84ec995c40be927956f56 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:46.758590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.793771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.795371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.795830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.796409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] PATH_INFO: `/v3/projects/88cdcef515394829ae6ee1de99e76599` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.797600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] RBAC: Authorizing `identity:get_project(project_id=88cdcef515394829ae6ee1de99e76599)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.799067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.800969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/projects/88cdcef515394829ae6ee1de99e76599 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:46.808009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.885470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.888215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e50881-e3f4-4842-abeb-984b759a1e75 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.923113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.923740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.924068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.924343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.925463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.926892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.930671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b04bc-9ce7-48a6-abb8-dfc78fe6ed06 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:46.933340 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:46.934056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:46.972899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:46.973504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:46.973789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:46.974059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:46.974778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] RBAC: Adding query filter params (role.id=ab9c3b4062604fe89c73ebd5acc431c7, scope.project.id=88cdcef515394829ae6ee1de99e76599, user.id=756f4309353f49bda9534cdd99dbb397) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:46.975084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:46.977093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680002-1733-4d78-9e6a-19d83fefa5c7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:46.979773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:46.995900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:46 2022] GET /identity/v3/role_assignments?user.id=756f4309353f49bda9534cdd99dbb397&scope.project.id=88cdcef515394829ae6ee1de99e76599&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:47.056168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61199-c8bc-43be-aad8-cf12cef9dc17 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:47.093514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0750f2-2dca-45be-a32b-dae7b407445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:47.094193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0750f2-2dca-45be-a32b-dae7b407445b None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:47.094542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0750f2-2dca-45be-a32b-dae7b407445b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:47.094832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0750f2-2dca-45be-a32b-dae7b407445b None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/389785b520e84ec995c40be927956f56/roles/798d5be62f4b4934ac0f3e8ee47281e5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:47.096824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0750f2-2dca-45be-a32b-dae7b407445b None admin] RBAC: Authorizing `identity:create_grant(project_id=f62a2c2b9817413184cb7c2cc540ae13, user_id=389785b520e84ec995c40be927956f56, role_id=798d5be62f4b4934ac0f3e8ee47281e5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:47.098331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0750f2-2dca-45be-a32b-dae7b407445b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:47.112683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 65/129] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:46 2022] PUT /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/users/389785b520e84ec995c40be927956f56/roles/798d5be62f4b4934ac0f3e8ee47281e5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 02:58:48.431225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2164e2-e476-4e57-ba31-bf0ac136102d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:48.431837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2164e2-e476-4e57-ba31-bf0ac136102d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:48.431837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2164e2-e476-4e57-ba31-bf0ac136102d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:48.433165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 65/130] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:48.438468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:48.438897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:48.439029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:48.457297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:48.458481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:48.522289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 66/131] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:48.790177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2164e2-e476-4e57-ba31-bf0ac136102d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:48.890172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2164e2-e476-4e57-ba31-bf0ac136102d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:48.911676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:48.923063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0b555-85d4-495f-9f07-d93707a8b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:48.923691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b555-85d4-495f-9f07-d93707a8b3ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:48.924006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b555-85d4-495f-9f07-d93707a8b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:48.924285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0b555-85d4-495f-9f07-d93707a8b3ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:48.925374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0b555-85d4-495f-9f07-d93707a8b3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:48.926810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0b555-85d4-495f-9f07-d93707a8b3ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:48.928560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:48.934474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:48.964251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:49.032081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba94da-728b-479a-8437-7abaedad625d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:49.064569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22cf8c-1652-4091-8329-b8091ca7b36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:49.065127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cf8c-1652-4091-8329-b8091ca7b36c None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:49.065399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cf8c-1652-4091-8329-b8091ca7b36c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:49.065675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22cf8c-1652-4091-8329-b8091ca7b36c None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:49.066332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22cf8c-1652-4091-8329-b8091ca7b36c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:49.067768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22cf8c-1652-4091-8329-b8091ca7b36c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:49.094833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 67/133] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:58:48 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:49.240620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289e14-1de8-4f93-a453-2b4fd7e3c815 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:49.241020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289e14-1de8-4f93-a453-2b4fd7e3c815 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:49.241378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6289e14-1de8-4f93-a453-2b4fd7e3c815 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:49.242717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 67/134] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:49.249060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:49.249359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:49.249639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:49.268385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:49.269578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:49.337230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 68/135] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:49.607919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6289e14-1de8-4f93-a453-2b4fd7e3c815 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:49.712983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6289e14-1de8-4f93-a453-2b4fd7e3c815 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:49.748285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:49.748921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:49.749209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:49.749491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:49.760651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:49.765536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:49.766426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:49.767332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 68/136] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:49.774276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:49.795012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:49.882608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fa135-8cdb-40a6-8630-7f5ae556cf54 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:49.918113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:49.919076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:49.919585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:49.920091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:49.920970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:49.921486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:49.923271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:49.932073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 69/137] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:49.943898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:49.996630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:50.048229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc0350-8c33-499f-8ea9-d9047214e18f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:50.082806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:50.083440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:50.083720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:50.084022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] PATH_INFO: `/v3/users/389785b520e84ec995c40be927956f56` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:50.085228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] RBAC: Authorizing `identity:get_user(user_id=389785b520e84ec995c40be927956f56)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:50.086689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:50.088333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 69/138] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:49 2022] GET /identity/v3/users/389785b520e84ec995c40be927956f56 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:50.094172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:50.177096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:50.203847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35275c-efa6-4dc0-8b86-06f04078f7b5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:50.238137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:50.238745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:50.239027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:50.239303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:50.312546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:50.314001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:50.398144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:50.414739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:50.420528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:50.526968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e05ea-f6e5-44cd-a7a9-cb6a96079bcf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:50.545384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:50.564682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7ab5-637f-4a70-b9eb-93962933bd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:50.565552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7ab5-637f-4a70-b9eb-93962933bd6c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:50.565977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7ab5-637f-4a70-b9eb-93962933bd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:50.566391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7ab5-637f-4a70-b9eb-93962933bd6c None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:50.567656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7ab5-637f-4a70-b9eb-93962933bd6c None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:50.569850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7ab5-637f-4a70-b9eb-93962933bd6c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:50.571720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 70/140] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:50 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:50.580961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:50.688033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6a3a3-ceb6-407f-9c4e-bcfbbd93ecc7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:50.722784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:50.723396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:50.723832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:50.724142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:50.724864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] RBAC: Adding query filter params (role.id=798d5be62f4b4934ac0f3e8ee47281e5, scope.project.id=f62a2c2b9817413184cb7c2cc540ae13, user.id=389785b520e84ec995c40be927956f56) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:50.725170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:50.726636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed049019-53e2-4ac5-8658-6574d7b3a9f0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:50.732629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 71/141] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:50 2022] GET /identity/v3/role_assignments?user.id=389785b520e84ec995c40be927956f56&scope.project.id=f62a2c2b9817413184cb7c2cc540ae13&role.id=798d5be62f4b4934ac0f3e8ee47281e5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:51.419029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cfe86-5f22-4db3-ac97-7e1b81784656 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.419556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cfe86-5f22-4db3-ac97-7e1b81784656 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.419556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cfe86-5f22-4db3-ac97-7e1b81784656 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.420954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 71/142] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:51.426206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263c711-9e0b-40ec-aeca-8f176b7f5c00 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.426596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263c711-9e0b-40ec-aeca-8f176b7f5c00 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.426757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b263c711-9e0b-40ec-aeca-8f176b7f5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.445956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b263c711-9e0b-40ec-aeca-8f176b7f5c00 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:51.447185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b263c711-9e0b-40ec-aeca-8f176b7f5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:51.489672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:51.524287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 72/143] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:51.571187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce0a4-2713-404e-9f33-f986f9697bf3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.571717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce0a4-2713-404e-9f33-f986f9697bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.572160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefce0a4-2713-404e-9f33-f986f9697bf3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.573668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 72/144] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:51.578969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.579427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.579848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.596778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73032ed-9e35-4e1e-9dd0-21e9df43ae51 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.597104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73032ed-9e35-4e1e-9dd0-21e9df43ae51 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.597496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73032ed-9e35-4e1e-9dd0-21e9df43ae51 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.599038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 73/145] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:51.600091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:51.601525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:51.603960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.604250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.605383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.625894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:51.627595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:51.674160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 73/146] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:51.703466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 74/147] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:51.791264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:51.891192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a375b-1783-4b24-8954-2b4779a48403 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:51.892715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:51.926305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:51.926874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:51.927214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:51.927490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:51.937903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:51.942716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:51.943564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:51.949633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 74/148] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:51.950441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:51.950521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.049453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbc513-d99a-40e0-9ad3-7feba8016dca None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.050043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36670a43-29bc-4aaa-abeb-7fdeaeb59580 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.065520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.083766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.083997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.084405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.084509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.084682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.084785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.084967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.085584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.086160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:52.086459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.087847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.095559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:52.095838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 75/149] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.097732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:52.100461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:52.101420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:52.102200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 75/150] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:58:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:52.102903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.125188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.199415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c74e3-82d0-4215-9bff-92418a132ab5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.202398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bfc54-539b-42d2-b072-b22706924acd None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.232146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.232768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.233047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.233321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] PATH_INFO: `/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.234653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.235266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.235544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.235834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.236956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.238396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.239957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.245148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.246919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] RBAC: Authorizing `identity:get_user(user_id=f3e7c56ca38a4524b67b07f91c8f11ae)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.248400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.254373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 76/152] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:52 2022] GET /identity/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.254373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.286991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.338213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.346922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734ab5d-152b-41e2-82cd-7041edb596b5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.350995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d7a46-1d40-4441-9708-41f4ba075f5d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.379805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.380430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.380706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.380972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.381628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:52.381967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.383349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.383863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.384493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.384774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.385048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.385695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.387112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.391062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 77/153] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:58:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.391839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.409674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 77/154] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:58:52 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:52.417054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.509518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f0e06-f5d0-491c-8b11-7a79723b408e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.526399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.539111 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877fe88-7f4c-41d8-ae1e-6878ca7408c1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.549955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.551143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.551608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.551902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.553082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.555109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.557038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 78/155] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:52 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.562648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.578542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.579234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.579516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.579787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] PATH_INFO: `/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.580971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] RBAC: Authorizing `identity:get_user(user_id=f3e7c56ca38a4524b67b07f91c8f11ae)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.582425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.584025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 78/156] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:52 2022] GET /identity/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.591624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.594318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.687651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177bba-98f0-4b54-987f-8951d00028fa None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.707453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ac48c-07d6-4b9b-9ff1-4c111d423a8a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.722791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.723452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.723733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.724082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/f3e7c56ca38a4524b67b07f91c8f11ae/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.726132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] RBAC: Authorizing `identity:create_grant(project_id=26800e77f5d7408c83ef840f5d2f30ea, user_id=f3e7c56ca38a4524b67b07f91c8f11ae, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.727568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.746298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 79/157] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:52 2022] PUT /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/f3e7c56ca38a4524b67b07f91c8f11ae/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:52.746498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b2de-07dc-41a8-b5de-0656716aafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.746856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b2de-07dc-41a8-b5de-0656716aafa9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.747164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b2de-07dc-41a8-b5de-0656716aafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.747399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b2de-07dc-41a8-b5de-0656716aafa9 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.748574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b2de-07dc-41a8-b5de-0656716aafa9 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.750052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b2de-07dc-41a8-b5de-0656716aafa9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.752872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 79/158] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:52 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:52.759394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:52.860964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:52.882105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e586c25-8c9c-4d98-8903-19a1ddd6718f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:52.920219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb1b1c-8652-4e31-bd86-87e2325ac710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:52.920896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1b1c-8652-4e31-bd86-87e2325ac710 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:52.921178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1b1c-8652-4e31-bd86-87e2325ac710 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:52.921455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb1b1c-8652-4e31-bd86-87e2325ac710 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/f3e7c56ca38a4524b67b07f91c8f11ae/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:52.923791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb1b1c-8652-4e31-bd86-87e2325ac710 None admin] RBAC: Authorizing `identity:create_grant(project_id=26800e77f5d7408c83ef840f5d2f30ea, user_id=f3e7c56ca38a4524b67b07f91c8f11ae, role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:52.925277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb1b1c-8652-4e31-bd86-87e2325ac710 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:52.940720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 80/159] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:52 2022] PUT /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/f3e7c56ca38a4524b67b07f91c8f11ae/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:54.699602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4079a9-6ed0-47e1-9fd8-dd311e4eaed7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:54.700175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4079a9-6ed0-47e1-9fd8-dd311e4eaed7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:54.700175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4079a9-6ed0-47e1-9fd8-dd311e4eaed7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:54.701532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 80/160] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:54.706812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a9570-ce6c-4061-95b3-2d1828d2a76b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:54.707242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a9570-ce6c-4061-95b3-2d1828d2a76b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:54.707451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a9570-ce6c-4061-95b3-2d1828d2a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:54.726596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f35a9570-ce6c-4061-95b3-2d1828d2a76b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:54.727825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f35a9570-ce6c-4061-95b3-2d1828d2a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:54.806787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 81/161] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:54.854005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdf730-23df-4db4-8934-af4400887d56 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:54.854301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdf730-23df-4db4-8934-af4400887d56 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:54.854560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdf730-23df-4db4-8934-af4400887d56 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:54.855954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 81/162] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:54.861101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4c818-b3e8-4da9-a613-ee4fc400150a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:54.861398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4c818-b3e8-4da9-a613-ee4fc400150a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:54.861681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4c818-b3e8-4da9-a613-ee4fc400150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:54.880684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4bb4c818-b3e8-4da9-a613-ee4fc400150a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:54.882245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4bb4c818-b3e8-4da9-a613-ee4fc400150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:54.961863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 82/163] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:55.012045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475b65-498e-4f14-b918-17bfb56403fa None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.012332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475b65-498e-4f14-b918-17bfb56403fa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.012782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9475b65-498e-4f14-b918-17bfb56403fa None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.014284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 82/164] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:55.019515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.019811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.020124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.026440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.039677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:55.040888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:55.087087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991be1-e48c-4f42-9e76-f5f70d79e216 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.087716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991be1-e48c-4f42-9e76-f5f70d79e216 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.088320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39991be1-e48c-4f42-9e76-f5f70d79e216 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.089965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 83/165] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:55.095246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.095526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.095799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.115909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 83/166] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:55.117035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:55.118464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:55.121384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.141469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.207896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 84/167] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:55.233407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480f0b9-45bb-414d-b69a-6810f8c27e59 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.254264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.265818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.271721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.272323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.272660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.273042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.284479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:55.290134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:55.291026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:55.291810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 84/168] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:58:55.297293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.367572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406c480-ea2e-46ae-b999-1659c14dda30 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.401995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad62b94-95fe-4d6a-9196-6ee8db30fcf9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.406038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.406672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.406956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.407229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.408360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:55.409808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:55.411381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 85/169] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:55.417110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.436754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.437363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.437642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.437913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.438632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:55.438936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:55.440366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:55.444464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.448802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 85/170] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:55.452720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.514060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.523213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a1ffb-81c2-4c0d-912e-718d66cfffc7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.555576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.556235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.556510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.556785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.559376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549356a-6a35-41e8-a308-86f6f00eb5b2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.566428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:55.571643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:55.572744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 86/171] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:55.573588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.595194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.595799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.596112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.596385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.597034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:55.598457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:55.619698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 86/172] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:58:55 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:58:55.620548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.685247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.703471 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d47a9-ddda-4c00-83ad-816daa559632 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.736783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72a2a6-574a-4751-bfcc-336a9129ebf6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.742915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.743561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.743842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.744159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] PATH_INFO: `/v3/users/952f1914832e488f81f453701168a406` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.750145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.759389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] RBAC: Authorizing `identity:get_user(user_id=952f1914832e488f81f453701168a406)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:55.760910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:55.762647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 87/173] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/users/952f1914832e488f81f453701168a406 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:55.767717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.784914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.785560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.785840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.786111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.798157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:55.803478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:55.805028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:55.805834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 87/174] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:55.806504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.886378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81659d58-3497-4d81-8846-e284426d0172 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.932182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.933103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.933382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.933661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.934328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:55.934629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:55.936172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:55.938605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705f298-7a96-426a-8652-d2a150b3be35 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:55.946025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 88/175] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:55.947049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:55.952455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:55.992893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:55.992893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:55.993214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:55.993442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:55.995172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:55.996670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:55.998316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 88/176] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:55.999956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.046771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:56.089997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50544645-b25e-43ad-a12c-f836c3507f35 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:56.111577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ea8d3-1a98-460f-a090-3f6ae5b20ec7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:56.136317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:56.137536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:56.138033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:56.138509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:56.139552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:56.140106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:56.142258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:56.148291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:56.148976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:56.149283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:56.149880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] PATH_INFO: `/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:56.150940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] RBAC: Authorizing `identity:get_user(user_id=f3e7c56ca38a4524b67b07f91c8f11ae)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:56.152551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:56.153415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 89/177] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:56.154187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 89/178] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:55 2022] GET /identity/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:56.158876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.159986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.245152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:56.281760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5a45e-af6b-4443-85c3-6f3c15828d78 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:56.289874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:56.297328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a91e16-1130-41e6-94a5-9e0e992916de None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:56.337983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:56.339110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:56.339227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:56.339718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:56.339946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:56.340254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:56.340533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/952f1914832e488f81f453701168a406/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:56.340834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] PATH_INFO: `/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:56.342386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] RBAC: Authorizing `identity:get_user(user_id=f3e7c56ca38a4524b67b07f91c8f11ae)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:56.342596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] RBAC: Authorizing `identity:create_grant(project_id=26800e77f5d7408c83ef840f5d2f30ea, user_id=952f1914832e488f81f453701168a406, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:56.344100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:56.344490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:56.346910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 90/179] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:56 2022] GET /identity/v3/users/f3e7c56ca38a4524b67b07f91c8f11ae => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:56.348624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.367903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 90/180] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:56 2022] PUT /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/952f1914832e488f81f453701168a406/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:56.367903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.565854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbfb50-976b-4f0f-b25c-220c155ed02e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:56.577193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50361379-34bb-4ef0-9282-2b58b18e75cc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:56.611039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:56.612302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:56.612792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:56.613282 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:56.617139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:56.628520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:56.629595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:56.629974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:56.630348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:56.686771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:56.742016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:56.745294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:56.768957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:56.771955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:56.863816 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 91/181] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:56.877060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.886962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 91/182] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:58:56.896795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:56.974573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:56.988228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:57.005016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5a9b2-55aa-4cde-be9e-83a1ecd43ceb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:57.048069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:57.049180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:57.050967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:57.051450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:57.054052 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:57.055939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:57.058488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 92/183] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:56 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:57.064818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:57.137749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd19190-68af-47a0-b324-89fe3f7f804d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:57.192745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8d21-95ac-4f23-8c74-b53f67a1fd88 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:57.196522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:57.197154 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:57.197431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:57.197697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:57.199543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:57.201011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:57.202634 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 92/184] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:56 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:57.208200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:57.260750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:57.261366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:57.261643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:57.261916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:57.262643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=26800e77f5d7408c83ef840f5d2f30ea, user.id=f3e7c56ca38a4524b67b07f91c8f11ae) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:57.262948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:57.264425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d0c27-b187-4b95-aa0b-2db315b15f29 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:57.283418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 93/185] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:57 2022] GET /identity/v3/role_assignments?user.id=f3e7c56ca38a4524b67b07f91c8f11ae&scope.project.id=26800e77f5d7408c83ef840f5d2f30ea&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:57.343004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:57.350669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444d3a7-32e6-475a-afe4-094bded77768 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:57.396019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:57.396019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:57.396019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:57.396019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:57.396393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] RBAC: Adding query filter params (role.id=82925f6f46954c11888eaaf2678ac2e1, scope.project.id=26800e77f5d7408c83ef840f5d2f30ea, user.id=f3e7c56ca38a4524b67b07f91c8f11ae) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:57.396393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:57.396393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e707524-dc80-4834-a5af-042cba5f8c57 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:57.407901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 93/186] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:58:57 2022] GET /identity/v3/role_assignments?user.id=f3e7c56ca38a4524b67b07f91c8f11ae&scope.project.id=26800e77f5d7408c83ef840f5d2f30ea&role.id=82925f6f46954c11888eaaf2678ac2e1 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:58.098431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d704-6d6c-456f-884d-d517f2f5754f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.098975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d704-6d6c-456f-884d-d517f2f5754f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.098975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645d704-6d6c-456f-884d-d517f2f5754f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.100591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 94/187] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:58:58.106599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.107066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.107135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.125304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:58.126480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:58.193417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b861-ecf0-4049-9b36-f9f13af8d8a2 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.193712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b861-ecf0-4049-9b36-f9f13af8d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.193974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10b861-ecf0-4049-9b36-f9f13af8d8a2 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.195431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 95/189] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:58.195956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 94/189] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:58:58.200404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.200765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.201103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.214953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:58.221551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:58.222808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:58.289386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 96/190] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:58:58.466780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:58.552752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:58.560050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:58.567369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c410f-5dbe-4a96-b0db-1940fd8b4572 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:58.602814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:58.603454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.603735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.604043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.619392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:58.624282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:58.625159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:58:58.625965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 95/191] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:58.632535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:58.669584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff044f-5b31-4995-b358-0b326b9322b5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:58.706636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:58.707273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.707554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.707831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.708983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:58.710509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:58.712540 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 97/192] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:58.718054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:58.721493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:58.738498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84e504-f1b6-4695-a744-1c383caf9039 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:58.777071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:58.777675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.777954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.778226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.779009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:58.779425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:58.780841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:58.789669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 96/193] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:58.795185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:58.808745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:58.821251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c9b9a-efc6-426c-86d9-f01c47a9bb07 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:58.855145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:58.855768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.856071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.856410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.857019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:58.858495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:58.885465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 98/194] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:58:58 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:58:58.914688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10d394-4665-4455-a2b6-6aae73276085 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:58.954345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420d155-b173-4996-956c-16f35e39aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:58.955381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420d155-b173-4996-956c-16f35e39aec1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.955911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420d155-b173-4996-956c-16f35e39aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.956388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420d155-b173-4996-956c-16f35e39aec1 None admin] PATH_INFO: `/v3/users/b1e7bf5e91944533adabd0ed25efb777` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.974798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420d155-b173-4996-956c-16f35e39aec1 None admin] RBAC: Authorizing `identity:get_user(user_id=b1e7bf5e91944533adabd0ed25efb777)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:58.976313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420d155-b173-4996-956c-16f35e39aec1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:58.978372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 97/195] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:58 2022] GET /identity/v3/users/b1e7bf5e91944533adabd0ed25efb777 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:58:58.983808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:58.985885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6b639-0d54-46ce-9b93-2fbd05db2acb None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.986175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6b639-0d54-46ce-9b93-2fbd05db2acb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.986448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6b639-0d54-46ce-9b93-2fbd05db2acb None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:58.987813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 98/196] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:58:58.995022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:58.995305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:58.995580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:59.018385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:58:59.019800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:58:59.052041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:59.095615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:59.103344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:58:59.110155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1cf3f-889f-4086-831d-2758ad896298 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:59.149812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:59.150458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:59.150745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:59.151021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:59.152192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:59.153637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:59.155354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 99/198] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:58:58 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:59.161109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:59.269084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27a8dc-b080-403a-a7cb-fa7df5cb1dfd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:59.306037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:59.306706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:59.306986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:59.307261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/b1e7bf5e91944533adabd0ed25efb777/roles/798d5be62f4b4934ac0f3e8ee47281e5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:59.309208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=26800e77f5d7408c83ef840f5d2f30ea, user_id=b1e7bf5e91944533adabd0ed25efb777, role_id=798d5be62f4b4934ac0f3e8ee47281e5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:59.310658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:59.327369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 100/199] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:58:59 2022] PUT /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/users/b1e7bf5e91944533adabd0ed25efb777/roles/798d5be62f4b4934ac0f3e8ee47281e5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:58:59.370580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:59.489767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9041de1-b51d-4c7e-8fa7-5b0baa50dbe3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:59.523693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:59.531566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:59.532274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:59.532749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:59.533251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:59.544098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:58:59.549406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:58:59.550289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:58:59.551107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 100/200] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:58:59.557121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:59.621595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:58:59.666675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf63e4-17dd-4917-a93b-0151dfeeaae6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:59.701396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:59.702009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:59.702289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:59.702556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:59.703215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:58:59.703512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:59.704914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:59.713896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:58:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:59.719907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:59.823716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270ef6d-9c85-4d22-9395-403768c20bc2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:58:59.860363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:58:59.860999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:58:59.861283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:58:59.861556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] PATH_INFO: `/v3/users/952f1914832e488f81f453701168a406` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:58:59.862697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] RBAC: Authorizing `identity:get_user(user_id=952f1914832e488f81f453701168a406)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:58:59.864307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:58:59.870763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 101/202] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:58:59 2022] GET /identity/v3/users/952f1914832e488f81f453701168a406 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:58:59.872299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:58:59.982518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f053a-ae35-4e29-9e78-dd572152a8a7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:00.003990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:00.026318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:00.026962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:00.027243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:00.027516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:00.098041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:00.099493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:00.206025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 102/203] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:00.207378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:00.269211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:00.318048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e695-136b-487b-9afc-d1084ea68e65 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:00.357345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2155c5a-5f99-4502-bb75-31901c6d0867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:00.357899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2155c5a-5f99-4502-bb75-31901c6d0867 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:00.358180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2155c5a-5f99-4502-bb75-31901c6d0867 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:00.358449 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2155c5a-5f99-4502-bb75-31901c6d0867 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:00.359569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2155c5a-5f99-4502-bb75-31901c6d0867 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:00.361057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2155c5a-5f99-4502-bb75-31901c6d0867 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:00.363078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 102/204] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:00 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:00.368868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:00.390583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:00.473188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba1f7a-d9cb-4c7e-9c93-6a22789abc90 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:00.508530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:00.509139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:00.509420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:00.509690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:00.510404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] RBAC: Adding query filter params (role.id=ab9c3b4062604fe89c73ebd5acc431c7, scope.project.id=26800e77f5d7408c83ef840f5d2f30ea, user.id=952f1914832e488f81f453701168a406) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:00.510712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:00.512170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3e849-8d51-46d2-ae97-c157624ca5bc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:00.518021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:00 2022] GET /identity/v3/role_assignments?user.id=952f1914832e488f81f453701168a406&scope.project.id=26800e77f5d7408c83ef840f5d2f30ea&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:01.278672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb960e-963b-41a0-968c-1798d35ebeae None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.279200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb960e-963b-41a0-968c-1798d35ebeae None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.279200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb960e-963b-41a0-968c-1798d35ebeae None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.280608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 103/206] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:01.285711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32d79-af37-423b-802d-0180afffb317 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.286106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32d79-af37-423b-802d-0180afffb317 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.286279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af32d79-af37-423b-802d-0180afffb317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.304951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3af32d79-af37-423b-802d-0180afffb317 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:01.306120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3af32d79-af37-423b-802d-0180afffb317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:01.315487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62486a4-5f57-474f-9749-69587d3c2400 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.315775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62486a4-5f57-474f-9749-69587d3c2400 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.316102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62486a4-5f57-474f-9749-69587d3c2400 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.317476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 104/207] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:01.322214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89987731-d8f7-4779-9f7e-a3255374b8c2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.322505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89987731-d8f7-4779-9f7e-a3255374b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.322789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89987731-d8f7-4779-9f7e-a3255374b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.340984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-89987731-d8f7-4779-9f7e-a3255374b8c2 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:01.342163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89987731-d8f7-4779-9f7e-a3255374b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:01.375944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 104/208] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:01.413154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 105/209] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:01.552857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46506d-1d3e-44c7-b9b2-ec3cb2a724f8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.553095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46506d-1d3e-44c7-b9b2-ec3cb2a724f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.553559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46506d-1d3e-44c7-b9b2-ec3cb2a724f8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.558565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 105/210] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:01.560412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.560778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.561128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.579733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:01.580951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:01.631207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:01.641820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46506d-1d3e-44c7-b9b2-ec3cb2a724f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:01.650958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 106/211] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:01.658400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:01.682140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:01.747134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46506d-1d3e-44c7-b9b2-ec3cb2a724f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:01.782491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751f5cc-b835-491b-a653-2beec4d71f01 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:01.783305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:01.784076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.784356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.784656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.796184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:01.801445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:01.802326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:01.803168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 106/212] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:01.809654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:01.818678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:01.819344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.819628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.819927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.821030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:01.822476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:01.824065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 107/213] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:01.829216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:01.882338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:01.890507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:01.918568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53734c3-f850-4f6e-8ed3-7786be8bc6d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:01.931678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2539ca-0587-405c-8fd6-5f8ee772d2b3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:01.951985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:01.952601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.952881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.953157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.953822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:01.954127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:01.955514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:01.963674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 107/214] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:01.968397 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:01.968556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:01.969012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:01.969293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:01.969565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:01.970216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:01.971637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:01.992651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 108/215] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:01 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:59:01.993466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:02.084087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8adcc-4f6f-4d6f-bdfd-9d06fc3f42c4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.105845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2919f45-0f41-46ba-8e08-3c15c7a5e732 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.116226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:02.125748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.126708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.127188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.127636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.131623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:02.142345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:02.145892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.146543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.146830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.147103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] PATH_INFO: `/v3/users/413bde044b7e48b5a6ecc0e6a28ad7e4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:02.148029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:02.148921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:02.149696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 108/216] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:02.156151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:02.169280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] RBAC: Authorizing `identity:get_user(user_id=413bde044b7e48b5a6ecc0e6a28ad7e4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:02.170775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:02.173203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 109/217] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:01 2022] GET /identity/v3/users/413bde044b7e48b5a6ecc0e6a28ad7e4 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:02.178814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:02.272349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c2fef-0288-437e-b809-b2fc17000780 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.288381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81c80d-602d-4b3e-8a8e-770396f2e605 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.326796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.327413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.327699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.328036 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.328709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:02.329022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:02.330433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:02.330639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.331365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.331715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.332252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.333003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] RBAC: Adding query filter params (role.id=ab9c3b4062604fe89c73ebd5acc431c7, user.id=413bde044b7e48b5a6ecc0e6a28ad7e4, scope.system=all) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:02.333680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:02.335740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:02.341773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 109/219] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:02.342021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 110/219] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Oct 17 02:59:02 2022] GET /identity/v3/role_assignments?user.id=413bde044b7e48b5a6ecc0e6a28ad7e4&scope.system=all&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:02.349261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:02.422260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:02.469417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d6769-71da-4d86-af11-20380816dc0a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.508098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.508995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.509418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.509833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] PATH_INFO: `/v3/users/b1e7bf5e91944533adabd0ed25efb777` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.511194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] RBAC: Authorizing `identity:get_user(user_id=b1e7bf5e91944533adabd0ed25efb777)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:02.512854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:02.519315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 110/220] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:02 2022] GET /identity/v3/users/b1e7bf5e91944533adabd0ed25efb777 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:02.520876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:02.572067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:02.625735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e0e6-f082-4f38-b0c8-bcf62b51bd14 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.662629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.663537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.663980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.664391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.733601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:02.735272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:02.764581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:02.838946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 111/221] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:02.840544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:02.942902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72e18c-62bc-47b4-a7da-bc6733a76746 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:02.976344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:02.980473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba26ab-f077-4eb7-a922-77456edc1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:02.981120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba26ab-f077-4eb7-a922-77456edc1c12 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:02.981567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba26ab-f077-4eb7-a922-77456edc1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:02.981947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba26ab-f077-4eb7-a922-77456edc1c12 None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:02.982959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba26ab-f077-4eb7-a922-77456edc1c12 None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:02.984554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba26ab-f077-4eb7-a922-77456edc1c12 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:02.990299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 111/222] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:02 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:02.992752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:03.102592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c246c-4708-48cd-8d09-38ac8f4ffc9b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:03.133705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:03.140792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:03.141615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:03.142085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:03.142370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:03.143117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] RBAC: Adding query filter params (role.id=798d5be62f4b4934ac0f3e8ee47281e5, scope.project.id=26800e77f5d7408c83ef840f5d2f30ea, user.id=b1e7bf5e91944533adabd0ed25efb777) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:03.143427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:03.144908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca64d54-379c-4df6-b3fe-a9342b1b4492 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:03.151708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 112/223] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:02 2022] GET /identity/v3/role_assignments?user.id=b1e7bf5e91944533adabd0ed25efb777&scope.project.id=26800e77f5d7408c83ef840f5d2f30ea&role.id=798d5be62f4b4934ac0f3e8ee47281e5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:04.320186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dbf8-88bc-4c34-91af-13fea08bfc34 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.320702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dbf8-88bc-4c34-91af-13fea08bfc34 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.320702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dbf8-88bc-4c34-91af-13fea08bfc34 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.322074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 112/224] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:04.327284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc148aef-1f92-4295-b483-28d41c935d1b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.327673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc148aef-1f92-4295-b483-28d41c935d1b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.327836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc148aef-1f92-4295-b483-28d41c935d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.346725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cc148aef-1f92-4295-b483-28d41c935d1b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:04.347935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cc148aef-1f92-4295-b483-28d41c935d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:04.394012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d851-97f8-4682-bf2b-48b4426f748c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.394339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d851-97f8-4682-bf2b-48b4426f748c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.394570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d851-97f8-4682-bf2b-48b4426f748c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.395967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 113/225] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:04.401926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f6d7b-5f7b-4425-a48d-196b6b7c2c7e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.402381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f6d7b-5f7b-4425-a48d-196b6b7c2c7e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.402656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f6d7b-5f7b-4425-a48d-196b6b7c2c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.421009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ff7f6d7b-5f7b-4425-a48d-196b6b7c2c7e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:04.423999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 113/226] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:04.424116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ff7f6d7b-5f7b-4425-a48d-196b6b7c2c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:04.494126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 114/227] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:04.573350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3938e0-325c-43ae-b017-6c6e5b6378ab None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.573559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3938e0-325c-43ae-b017-6c6e5b6378ab None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.574000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3938e0-325c-43ae-b017-6c6e5b6378ab None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.575350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 114/228] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:04.580637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.580929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.581206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.599787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:04.601496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:04.673051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 115/229] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:04.691407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3938e0-325c-43ae-b017-6c6e5b6378ab None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:04.757412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:04.796067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3938e0-325c-43ae-b017-6c6e5b6378ab None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:04.813497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:04.820860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:04.831443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:04.832049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.832325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.832676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.843099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:04.847854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:04.848784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:04.852871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 115/230] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:04.855116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:04.870338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6983f5-31d5-4894-a250-62e4ef0458e5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:04.916624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:04.917250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.917527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.917793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.919097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:04.920576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:04.922396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 116/231] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:04.927497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:04.958129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdacc0-d50c-43e9-b76f-5d10cb8397b9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:04.993618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:04.994225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:04.994508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:04.994786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:04.995443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:04.995748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:04.997169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.005333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 116/232] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:05.006116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:05.030122 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25e4554-9111-495e-bb22-08f63b6a40dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.050726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:05.051603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:05.064078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.064689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.065004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.065228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] PATH_INFO: `/v3/groups` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.065981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:05.067279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.083277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 117/233] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Oct 17 02:59:04 2022] POST /identity/v3/groups => generated 229 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:59:05.083418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:05.107141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec72c9-213c-4eb9-8a7d-a8527421df4f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.150586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.151239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.151585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.151904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.164235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:05.169737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:05.170715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:05.171569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 117/234] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:05.177157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:05.215385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ea0ff-cdab-4380-a72f-73f268fed031 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.253415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.254160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.255082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.255082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] PATH_INFO: `/v3/users/83c3e315d1b343bdac7e87f585c7b4c3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.269056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] RBAC: Authorizing `identity:get_user(user_id=83c3e315d1b343bdac7e87f585c7b4c3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:05.270524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.272213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 118/235] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:05 2022] GET /identity/v3/users/83c3e315d1b343bdac7e87f585c7b4c3 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:05.278641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:05.290152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb7001-e7e0-4c80-86f7-182679638461 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.297534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:05.324699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:05.331727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.332629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.332912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.333217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.334046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:05.334215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:05.336160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.345163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 118/236] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:05.350605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:05.388866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502433f6-9b54-4bda-bb3a-7252d24cef21 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.424285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.424916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.425190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.425457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.426172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] RBAC: Adding query filter params (role.id=798d5be62f4b4934ac0f3e8ee47281e5, user.id=83c3e315d1b343bdac7e87f585c7b4c3, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:05.426479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:05.427934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.433446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 119/237] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Oct 17 02:59:05 2022] GET /identity/v3/role_assignments?user.id=83c3e315d1b343bdac7e87f585c7b4c3&scope.system=all&role.id=798d5be62f4b4934ac0f3e8ee47281e5 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:05.456300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27251f4-f34e-4685-9f92-586fd995409d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.495140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d810b-b55c-4a98-ae58-98b83d88e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.496151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d810b-b55c-4a98-ae58-98b83d88e56b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.496641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d810b-b55c-4a98-ae58-98b83d88e56b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.497092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d810b-b55c-4a98-ae58-98b83d88e56b None admin] PATH_INFO: `/v3/users/413bde044b7e48b5a6ecc0e6a28ad7e4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.498508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d810b-b55c-4a98-ae58-98b83d88e56b None admin] RBAC: Authorizing `identity:get_user(user_id=413bde044b7e48b5a6ecc0e6a28ad7e4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:05.500189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d810b-b55c-4a98-ae58-98b83d88e56b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.502347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 119/238] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:05 2022] GET /identity/v3/users/413bde044b7e48b5a6ecc0e6a28ad7e4 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:05.507927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:05.617443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f0917-5252-4ad9-a6e8-9620d8a6c927 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:05.620731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:05.654152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58c85-2944-4f4e-a238-6d8b592d5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:05.654804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58c85-2944-4f4e-a238-6d8b592d5e74 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:05.655085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58c85-2944-4f4e-a238-6d8b592d5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:05.655358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58c85-2944-4f4e-a238-6d8b592d5e74 None admin] PATH_INFO: `/v3/system/users/413bde044b7e48b5a6ecc0e6a28ad7e4/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:05.656906 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58c85-2944-4f4e-a238-6d8b592d5e74 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=413bde044b7e48b5a6ecc0e6a28ad7e4, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:05.658292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58c85-2944-4f4e-a238-6d8b592d5e74 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:05.667332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 120/239] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Oct 17 02:59:05 2022] PUT /identity/v3/system/users/413bde044b7e48b5a6ecc0e6a28ad7e4/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:07.285793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57266a30-9c8b-4f74-aa16-b148b0039dd0 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.286301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57266a30-9c8b-4f74-aa16-b148b0039dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.286375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57266a30-9c8b-4f74-aa16-b148b0039dd0 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.287708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 120/240] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:07.292971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ade72-caff-4ff4-a213-31ff86b8852b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.293345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ade72-caff-4ff4-a213-31ff86b8852b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.293524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ade72-caff-4ff4-a213-31ff86b8852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.312011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e11ade72-caff-4ff4-a213-31ff86b8852b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:07.313188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e11ade72-caff-4ff4-a213-31ff86b8852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:07.380944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 121/241] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:07.539756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c37e-f4d6-47da-b5f6-75d2e6275a95 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.540155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c37e-f4d6-47da-b5f6-75d2e6275a95 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.540244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7c37e-f4d6-47da-b5f6-75d2e6275a95 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.541706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 121/242] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:07.546625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc151-e8c4-46f1-96cc-086afb27dd39 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.546913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc151-e8c4-46f1-96cc-086afb27dd39 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.547184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc151-e8c4-46f1-96cc-086afb27dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.565754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bfcbc151-e8c4-46f1-96cc-086afb27dd39 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:07.566919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bfcbc151-e8c4-46f1-96cc-086afb27dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:07.636456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 122/243] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:07.651076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7c37e-f4d6-47da-b5f6-75d2e6275a95 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:07.692868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:07.760366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7c37e-f4d6-47da-b5f6-75d2e6275a95 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:07.788667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7223b-ca1d-48de-8a61-b687568ed6de None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.788961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7223b-ca1d-48de-8a61-b687568ed6de None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.789239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7223b-ca1d-48de-8a61-b687568ed6de None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.792035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 123/244] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:07.794826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:07.795453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.795734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.795828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.796063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.796158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.796338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.797156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:07.798577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:07.800479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 122/245] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:07.806415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:07.818242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:07.820071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:07.846138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:07.893897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 124/246] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:07.903275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:07.910530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a999548-70e2-41ca-85ff-c2c3460d95f8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:07.913933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:07.947534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:07.948175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:07.948451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:07.948716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] PATH_INFO: `/v3/groups` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:07.949346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:07.950769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:07.970917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 123/247] 10.222.0.20 () {60 vars in 1134 bytes} [Mon Oct 17 02:59:07 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:08.018340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364fb23-6cdf-4efa-8aaf-17b62f4235a0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.056516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.057129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.057411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.057679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.070364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:08.075266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:08.076247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:08.077068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 125/248] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:08.083731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.169876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.190921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c2772-bc4b-431f-a240-d2c8e850ea50 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.191099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:08.231409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.232023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.232357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.232635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.233297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:08.233600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:08.234974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:08.244875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 124/249] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:08.249984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.282964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:08.292877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd443513-50b7-4722-b8bc-d509d260db34 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.340228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.340822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.341063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.341303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.354371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:08.359216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:08.360187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:08.361009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:08.364015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 126/250] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:08.367160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.375617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4ae10-1bfb-4322-9d1c-13d8e088d781 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.420314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.420959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.421229 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.421502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] PATH_INFO: `/v3/users/83c3e315d1b343bdac7e87f585c7b4c3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.422772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] RBAC: Authorizing `identity:get_user(user_id=83c3e315d1b343bdac7e87f585c7b4c3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:08.424430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:08.426235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 125/251] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:08 2022] GET /identity/v3/users/83c3e315d1b343bdac7e87f585c7b4c3 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:08.433353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.475374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:08.503760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad8039-fe38-4a7a-b3e7-b6fcfeaa2da8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.548463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.549746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.550469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.550893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.552008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:08.554852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:08.554852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:08.555267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:08.562431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429a4bc-1496-40d0-a1b6-8be240f7c967 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.570700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 127/252] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:08.576259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.599509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.600511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.600976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.601431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] PATH_INFO: `/v3/system/users/83c3e315d1b343bdac7e87f585c7b4c3/roles/798d5be62f4b4934ac0f3e8ee47281e5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.603089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=83c3e315d1b343bdac7e87f585c7b4c3, role_id=798d5be62f4b4934ac0f3e8ee47281e5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:08.604741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:08.614984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 126/253] 10.222.0.20 () {58 vars in 1334 bytes} [Mon Oct 17 02:59:08 2022] PUT /identity/v3/system/users/83c3e315d1b343bdac7e87f585c7b4c3/roles/798d5be62f4b4934ac0f3e8ee47281e5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 02:59:08.703180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0df0a-a8ea-4ee3-a36b-5d52bc3f5af0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.746371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca090b-8038-4d36-9e1d-86d9743d2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.747021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca090b-8038-4d36-9e1d-86d9743d2e18 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.747298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca090b-8038-4d36-9e1d-86d9743d2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.747571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca090b-8038-4d36-9e1d-86d9743d2e18 None admin] PATH_INFO: `/v3/users/413bde044b7e48b5a6ecc0e6a28ad7e4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.748829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca090b-8038-4d36-9e1d-86d9743d2e18 None admin] RBAC: Authorizing `identity:get_user(user_id=413bde044b7e48b5a6ecc0e6a28ad7e4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:08.750335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca090b-8038-4d36-9e1d-86d9743d2e18 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:08.752216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 128/254] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:08 2022] GET /identity/v3/users/413bde044b7e48b5a6ecc0e6a28ad7e4 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:08.758063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:08.871963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb31305-4545-463d-ade2-6405a4f74b4d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:08.908327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:08.908979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:08.909258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:08.909530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:08.910266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] RBAC: Adding query filter params (role.id=ab9c3b4062604fe89c73ebd5acc431c7, user.id=413bde044b7e48b5a6ecc0e6a28ad7e4, scope.system=all) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:08.910565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:08.912016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02bbc-b02c-44d8-9e04-e29e00a1b2ca None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:08.925527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 127/255] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Oct 17 02:59:08 2022] GET /identity/v3/role_assignments?user.id=413bde044b7e48b5a6ecc0e6a28ad7e4&scope.system=all&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:10.462171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e817-cacf-4a8f-b13a-89f79172063d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:10.462674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e817-cacf-4a8f-b13a-89f79172063d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:10.462674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3e817-cacf-4a8f-b13a-89f79172063d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:10.464385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 129/256] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:10.477233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:10.477687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:10.477873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:10.504862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:10.506061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:10.522235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:10.578418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 128/257] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 02:59:11.038689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e817-cacf-4a8f-b13a-89f79172063d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:11.052855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3e817-cacf-4a8f-b13a-89f79172063d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:11.058988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:11.059614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.059906 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.060184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.063720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:11.073141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:11.078041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:11.078929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:11.079707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 130/258] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 02:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:11.087355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:11.102226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1254-2da1-42c9-9a73-6ae6101783d9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:11.111385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:11.112234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.112710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.113219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.114074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:11.114568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:11.116835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 02:59:11.116835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 02:59:11.116835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 02:59:11.118096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:11.127797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 129/259] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 02:59:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:11.134211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:11.147089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3902576-8ddc-483b-9b3e-bf49f200939f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:11.155177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:11.155812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.156112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.156383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.166772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:11.168635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 02:59:11.168635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 02:59:11.168635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 02:59:11.169865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:11.171790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 131/260] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Oct 17 02:59:11 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:11.177208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:11.191389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ad30f-0249-440c-9bbe-f0679fe46025 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:11.199582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac7bc4-8898-4b74-ac80-fe3b0cf7ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:11.200460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac7bc4-8898-4b74-ac80-fe3b0cf7ab93 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.200940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac7bc4-8898-4b74-ac80-fe3b0cf7ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.201406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac7bc4-8898-4b74-ac80-fe3b0cf7ab93 admin admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.202735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac7bc4-8898-4b74-ac80-fe3b0cf7ab93 admin admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:11.205038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac7bc4-8898-4b74-ac80-fe3b0cf7ab93 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:11.207159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 130/261] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Oct 17 02:59:11 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:11.213130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:11.229743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eef87-ac32-4353-a8a9-9b7f8fd6486e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:11.236775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:11.237537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.237817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.238088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/groups/9539100edfdd4ceb8ede5fde80028853/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.241263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62a2c2b9817413184cb7c2cc540ae13, group_id=9539100edfdd4ceb8ede5fde80028853, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:11.242299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 02:59:11.242299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 02:59:11.242299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 02:59:11.244324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d6816-9e9f-4375-8b78-01cdd0bfafa2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:11.268806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 132/262] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Oct 17 02:59:11 2022] PUT /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/groups/9539100edfdd4ceb8ede5fde80028853/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:11.487068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325440-e0a3-4029-81c1-482af07b4d7e None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.488062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325440-e0a3-4029-81c1-482af07b4d7e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.488546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325440-e0a3-4029-81c1-482af07b4d7e None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.490337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 131/263] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:11.496553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6231dc-966f-49ca-ae37-f3bc263b1107 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.497035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6231dc-966f-49ca-ae37-f3bc263b1107 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.497134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6231dc-966f-49ca-ae37-f3bc263b1107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.524895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2c6231dc-966f-49ca-ae37-f3bc263b1107 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:11.526113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c6231dc-966f-49ca-ae37-f3bc263b1107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:11.618166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 133/264] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:11.740232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c9d0-e735-42a5-bdd4-f98a35bc6a8f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.740842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c9d0-e735-42a5-bdd4-f98a35bc6a8f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.742090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430c9d0-e735-42a5-bdd4-f98a35bc6a8f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.743699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 132/265] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:11.749128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4993b-1743-41d1-be80-3d35a22b63b7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:11.749422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4993b-1743-41d1-be80-3d35a22b63b7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:11.749702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4993b-1743-41d1-be80-3d35a22b63b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:11.773813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0db4993b-1743-41d1-be80-3d35a22b63b7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:11.775011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0db4993b-1743-41d1-be80-3d35a22b63b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:11.858346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 134/266] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 17 02:59:12.036863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c9d0-e735-42a5-bdd4-f98a35bc6a8f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.169917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430c9d0-e735-42a5-bdd4-f98a35bc6a8f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.172268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210d54-1ac1-4a1e-b2d6-2065c8927d76 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.172789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210d54-1ac1-4a1e-b2d6-2065c8927d76 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.173257 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8210d54-1ac1-4a1e-b2d6-2065c8927d76 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.175087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 135/267] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:12.181103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02773258-ebc2-4477-baa3-8f1a54210db8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.181660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02773258-ebc2-4477-baa3-8f1a54210db8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.182126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02773258-ebc2-4477-baa3-8f1a54210db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.205861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-02773258-ebc2-4477-baa3-8f1a54210db8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:12.207384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-02773258-ebc2-4477-baa3-8f1a54210db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:12.217554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 136/268] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 02:59:12.221715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ac8af-2aa6-4a81-99e3-fd3378bc703e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.222216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ac8af-2aa6-4a81-99e3-fd3378bc703e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.222784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ac8af-2aa6-4a81-99e3-fd3378bc703e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.224264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.224698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 137/269] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:12.227895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.227895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.227895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.231491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.232214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.233045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.242024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:12.247680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:12.248598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:12.249376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 133/270] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:12.265209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:12.266664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:12.271104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.277923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 138/271] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 02:59:12.298273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:12.375241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92dae8-9dbd-4cd7-8156-2f641f7cee80 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.410235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.410846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.411122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.411453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.412152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:12.412450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.413902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.421264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.433347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 134/272] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:12.433506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b597c-e96d-4c1e-9ec2-1afc2bf0da6c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.439896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.440531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.440804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.441070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.452724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.463558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:12.475532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:12.476475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:12.477255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 139/273] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:12.482647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.499113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a561e4-fdec-487d-831c-c7e064e08b49 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.511522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.512151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.512484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.512756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.513418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:12.513716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.514731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 02:59:12.514731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 02:59:12.514731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 02:59:12.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.535966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 140/274] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:12.543447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.558337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f4f5-f891-45c9-84b9-7b9fd7134d6c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.572392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.573027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.573359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.573630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.575780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.577871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.579619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 141/275] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:12.580146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:12.588337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.604924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b42946-e8ad-4c52-8037-d129a60e2e13 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.616219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.616853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.617286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.617389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.620289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.622491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.629185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 142/276] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:12.638404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.642134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5be06-c631-406e-b919-16a03e881cde None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.654709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae3bf0-7258-4998-8c6c-92a7ae0c1375 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.664255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.664979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.665408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.665730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/groups/9539100edfdd4ceb8ede5fde80028853/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.668260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62a2c2b9817413184cb7c2cc540ae13, group_id=9539100edfdd4ceb8ede5fde80028853, role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.671290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.698157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:12.703799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 143/277] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Oct 17 02:59:12 2022] PUT /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13/groups/9539100edfdd4ceb8ede5fde80028853/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:12.712699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.713379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.713668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.713943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] PATH_INFO: `/v3/users/83c3e315d1b343bdac7e87f585c7b4c3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.715279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=83c3e315d1b343bdac7e87f585c7b4c3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.716877 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.718604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 135/278] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/users/83c3e315d1b343bdac7e87f585c7b4c3 => generated 293 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:12.724834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.844426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.860626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb435d1f-ed16-42cf-bb8c-f2597f4fc7fe admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.912598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.913741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.914021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.914292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:12.915171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] RBAC: Adding query filter params (role.id=798d5be62f4b4934ac0f3e8ee47281e5, user.id=83c3e315d1b343bdac7e87f585c7b4c3, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:12.915492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:12.917361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:12.934024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 144/279] 10.222.0.20 () {56 vars in 1308 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/role_assignments?user.id=83c3e315d1b343bdac7e87f585c7b4c3&scope.system=all&role.id=798d5be62f4b4934ac0f3e8ee47281e5 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:12.934900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:12.981298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c60f25-7e63-4adc-b0d4-59bea4443ba0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:12.990017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:12.991483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:12.992082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:12.992548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.020592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:13.026317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:13.027261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:13.028090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 136/280] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:13.034323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdf225-cded-415a-89fa-95ec4e26dcb4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.034720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.042065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.042728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.043112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.043429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.048903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:13.054620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc77d78-8af8-46e6-8b8d-0f34faa360c7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.066613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.067230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:13.068544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.068893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.070806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.071590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:13.072016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.074915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:13.077625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:13.078512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:13.079293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:13.080487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 145/281] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 02:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:13.088060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.100941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 137/282] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:13.104672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba461547-29ad-44c2-bf2a-7269f1c19171 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.108920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.111795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.112441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.112731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.113033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.113804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:13.114111 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.115861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.125167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1782480-bd68-4e93-827a-d9c81445ae53 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.126552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 146/283] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:13.132738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.144354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988be45c-be2f-4b21-bdce-271544fa40cf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.155328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.156396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.156669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.157135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.157335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.157606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.157880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.158189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.160191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.160318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 02:59:13.160318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 02:59:13.160318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 02:59:13.161299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.161474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.164198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.166139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 147/285] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:13.166856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 138/285] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:13.170729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.176993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.185821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21406-9413-4633-bb35-5761a0e71349 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.192213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.193577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.194205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.194676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.196197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad47a7-f53d-4a6b-8ae4-e7a8e6a265a4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.198854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.201200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 148/286] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:13.207738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.213069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.214097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.214593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.215023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.217086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.220731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.221097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2bc4e2-1ef0-4b22-80ec-60ccaf01266b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.223789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 139/287] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:13.226971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e93e0-a11a-42a6-a9ba-014b33b40941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.227968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e93e0-a11a-42a6-a9ba-014b33b40941 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.228444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e93e0-a11a-42a6-a9ba-014b33b40941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.229029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e93e0-a11a-42a6-a9ba-014b33b40941 admin admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/groups/9539100edfdd4ceb8ede5fde80028853/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.231557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e93e0-a11a-42a6-a9ba-014b33b40941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26800e77f5d7408c83ef840f5d2f30ea, group_id=9539100edfdd4ceb8ede5fde80028853, role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.234596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e93e0-a11a-42a6-a9ba-014b33b40941 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.237484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.254686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 149/288] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Oct 17 02:59:13 2022] PUT /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/groups/9539100edfdd4ceb8ede5fde80028853/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 02:59:13.267757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf17ac-b6f4-4cba-bdeb-f1c7e603435d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.342502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.343537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.344104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.344580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/groups/9539100edfdd4ceb8ede5fde80028853/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.346831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=26800e77f5d7408c83ef840f5d2f30ea, group_id=9539100edfdd4ceb8ede5fde80028853, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.348170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 02:59:13.348170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 02:59:13.348170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 02:59:13.351270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.371848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8ee4-ed07-4df9-aa53-f4ae33fd44d8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.372492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8ee4-ed07-4df9-aa53-f4ae33fd44d8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.372970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b8ee4-ed07-4df9-aa53-f4ae33fd44d8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.375073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 150/289] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:13.376412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:13.383204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.383796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.384282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.395663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 140/290] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Oct 17 02:59:13 2022] PUT /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea/groups/9539100edfdd4ceb8ede5fde80028853/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:13.409208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:13.410745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:13.478898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 151/291] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 17 02:59:13.811298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.823426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02279bc2-9ebd-4fe4-bcd3-7ede86113cfc admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.831510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.832450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.832929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.833418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.852471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:13.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:13.859061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:13.859850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:13.862170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 141/292] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:13.868637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.878488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404342b-bfa3-455b-8177-5c6f2218e0b9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.887562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.888501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.888983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.889444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.890320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:13.890825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.897868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.907469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 152/293] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:13.913314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.923607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945cf26e-1cee-45b3-b070-5877ebea1ed3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.932343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.933223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.933699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.934165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] PATH_INFO: `/v3/groups/b2e0fd1057854f5bbc39db11075f7f08` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.940777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] RBAC: Authorizing `identity:get_group(group_id=b2e0fd1057854f5bbc39db11075f7f08)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.942932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.944858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 142/294] 10.222.0.20 () {56 vars in 1201 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/groups/b2e0fd1057854f5bbc39db11075f7f08 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:13.955747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:13.972006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1a6be-2c3c-42d8-8d99-83b427557e39 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:13.983643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea53be-9aeb-4621-aeb2-f01c371659c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:13.984600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea53be-9aeb-4621-aeb2-f01c371659c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:13.985076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea53be-9aeb-4621-aeb2-f01c371659c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:13.985538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea53be-9aeb-4621-aeb2-f01c371659c0 admin admin] PATH_INFO: `/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:13.986872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea53be-9aeb-4621-aeb2-f01c371659c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ee3c4f2dfdc417cadc7f4d4979df81a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:13.988924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea53be-9aeb-4621-aeb2-f01c371659c0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:13.991721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 153/295] 10.222.0.20 () {56 vars in 1207 bytes} [Mon Oct 17 02:59:13 2022] GET /identity/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:13.997921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:14.008295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9051c-ca7d-4dfd-a04a-80df10b77cba admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:14.016066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5684c7-f4d3-4bd3-b24a-825c119a442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:14.017044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5684c7-f4d3-4bd3-b24a-825c119a442a admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:14.017521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5684c7-f4d3-4bd3-b24a-825c119a442a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:14.017983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5684c7-f4d3-4bd3-b24a-825c119a442a admin admin] PATH_INFO: `/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a/groups/b2e0fd1057854f5bbc39db11075f7f08/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:14.020115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5684c7-f4d3-4bd3-b24a-825c119a442a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee3c4f2dfdc417cadc7f4d4979df81a, group_id=b2e0fd1057854f5bbc39db11075f7f08, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:14.023622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5684c7-f4d3-4bd3-b24a-825c119a442a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:14.046440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 143/296] 10.222.0.20 () {58 vars in 1463 bytes} [Mon Oct 17 02:59:13 2022] PUT /identity/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a/groups/b2e0fd1057854f5bbc39db11075f7f08/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:14.436889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ff1-1616-4fef-8f74-2182bc1fc86a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:14.437562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ff1-1616-4fef-8f74-2182bc1fc86a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:14.438037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc870ff1-1616-4fef-8f74-2182bc1fc86a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:14.439674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 154/297] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:14.445275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:14.445952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:14.446399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:14.467355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:14.468936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:14.551576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 144/298] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:14.831920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870ff1-1616-4fef-8f74-2182bc1fc86a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:14.961485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:14.968565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc870ff1-1616-4fef-8f74-2182bc1fc86a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:15.007866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:15.008524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:15.008808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:15.009083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:15.024354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:15.029216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:15.030087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:15.030886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 155/299] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:15.036426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:15.171840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:15.175802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cc11c-6ddb-4ae6-a044-1d2b5874c89f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:15.221796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:15.222415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:15.222697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:15.222969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:15.223638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:15.223977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:15.225906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:15.239367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 145/300] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:15.245290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:15.373832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ff65-d6ce-414e-8f54-0898fe84d2ac None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:15.408968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c8281-7aa2-4e3f-9944-fe15ad6daa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:15.409630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c8281-7aa2-4e3f-9944-fe15ad6daa95 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:15.409901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c8281-7aa2-4e3f-9944-fe15ad6daa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:15.410162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c8281-7aa2-4e3f-9944-fe15ad6daa95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:15.440341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:15.488172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c8281-7aa2-4e3f-9944-fe15ad6daa95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:15.489631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263c8281-7aa2-4e3f-9944-fe15ad6daa95 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:15.609454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 156/301] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:15.615082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:15.686744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa754a-ee99-413b-9e72-fee85bc35c1b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:15.687399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa754a-ee99-413b-9e72-fee85bc35c1b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:15.687984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa754a-ee99-413b-9e72-fee85bc35c1b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:15.689758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 157/302] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:15.695999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:15.696518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:15.697016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:15.723742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:15.726636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:15.780921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8143b-9cb2-4dba-93a2-d87425d6b386 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:15.816472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:15.836798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:15.837444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:15.838139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:15.838558 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:15.839897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:15.841518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:15.842916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 158/303] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:15.843632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 146/304] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:15 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:15.849023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:16.021854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856705ad-c01b-4b03-9034-c9dbfaf6c595 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:16.067552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:16.068204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.068482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.068750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.069948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:16.071392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:16.073292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 159/305] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Oct 17 02:59:15 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:16.078872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:16.122968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:16.220474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc88075-5329-4df8-afe8-9429c397c31f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:16.266678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:16.267308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.267588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.267859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.268629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] RBAC: Adding query filter params (group.id=9539100edfdd4ceb8ede5fde80028853, role.id=ab9c3b4062604fe89c73ebd5acc431c7, scope.project.id=f62a2c2b9817413184cb7c2cc540ae13) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:16.268934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:16.270396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e1bde-ec27-4566-a32a-c93ff5182bcf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:16.280990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 147/306] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Oct 17 02:59:16 2022] GET /identity/v3/role_assignments?group.id=9539100edfdd4ceb8ede5fde80028853&scope.project.id=f62a2c2b9817413184cb7c2cc540ae13&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:16.373065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:16.436539 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9b2e-c5b4-44c5-af02-97ca7725a1df None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.436888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9b2e-c5b4-44c5-af02-97ca7725a1df None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.437107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9b2e-c5b4-44c5-af02-97ca7725a1df None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.440051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 148/307] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:16.441183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49010114-9336-4773-af9b-b1283230a50b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.441464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49010114-9336-4773-af9b-b1283230a50b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.441739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49010114-9336-4773-af9b-b1283230a50b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.445166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 149/308] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:16.446243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12742-8ff8-4ee1-ae79-43d4fc91040b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.446695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12742-8ff8-4ee1-ae79-43d4fc91040b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.446977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b12742-8ff8-4ee1-ae79-43d4fc91040b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.453836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:16.478563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-08b12742-8ff8-4ee1-ae79-43d4fc91040b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:16.480148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-08b12742-8ff8-4ee1-ae79-43d4fc91040b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:16.514542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169ed9b-e429-4814-87c3-48ff1b2979a0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:16.558239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:16.558239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.558668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.558825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.568228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 150/309] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:16.576099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:16.577337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.577625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.577901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:16.578069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:16.578937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:16.579736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 160/310] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:16.588063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:16.606546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:16.607793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:16.629323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:16.697128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 151/311] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:16.712518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d4d82-30b4-4e55-a4e0-d0c542c916e7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:16.729778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:16.748178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:16.748868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.749144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.749409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.750118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:16.750416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:16.751844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:16.760544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 161/312] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:16.767620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:16.871146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfde43d-aabd-497d-b2fc-2ffb70a49534 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:16.906249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:16.906860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:16.907142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:16.907414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:16.914876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:16.935206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:16.988033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:16.989700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.040012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6c986-0d42-4370-b708-90e963fbf6b3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.085974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.086857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.087295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.087571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.100870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:17.106491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:17.107387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:17.108229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 162/313] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:17.108870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.122870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 152/314] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:17.128231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.169719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.202810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.247651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a37c-7335-4913-9b8c-b494624234dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.273085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b1a1c-0cff-47ca-aa6c-3f6cab47b640 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.291712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.292627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.293046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.293323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.309330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:17.313682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.314298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.314580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.314854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:17.315466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:17.316367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:17.317164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:17.317774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:17.317774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:17.317774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.317951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 163/315] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:17.319432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.328633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 153/316] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:17.329335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.442367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.445845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfebbf-6ce2-469d-80c2-5f33ba2e7875 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.452498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30159af-4293-4475-af70-3aab856f2576 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.470324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.483412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.484079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.484361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.484636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] PATH_INFO: `/v3/projects/f62a2c2b9817413184cb7c2cc540ae13` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.486190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] RBAC: Authorizing `identity:get_project(project_id=f62a2c2b9817413184cb7c2cc540ae13)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:17.489435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.491931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 164/317] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/projects/f62a2c2b9817413184cb7c2cc540ae13 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:17.491931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.496612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.497227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.497506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.497832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.498443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:17.498744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:17.500142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7121ece-6bcd-42fb-9d35-7b9c004c65b2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.508973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 154/318] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:17.510211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2110-b005-4e70-9505-2b02da5f3b39 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.510485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2110-b005-4e70-9505-2b02da5f3b39 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.510762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2110-b005-4e70-9505-2b02da5f3b39 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.512936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 155/319] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:17.513643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2110-b005-4e70-9505-2b02da5f3b39 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.618996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2b24f-954a-4571-8421-ef78cc4dffec None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.629860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2110-b005-4e70-9505-2b02da5f3b39 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.660064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e6c13-3ecf-46ec-81ad-aa11a12c8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.660677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e6c13-3ecf-46ec-81ad-aa11a12c8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.661330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e6c13-3ecf-46ec-81ad-aa11a12c8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.661330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e6c13-3ecf-46ec-81ad-aa11a12c8fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.668520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.669159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.669443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.669718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.671363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:17.673226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.675601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 156/320] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:17.676334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.702774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.732744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.740323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e6c13-3ecf-46ec-81ad-aa11a12c8fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:17.742368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e6c13-3ecf-46ec-81ad-aa11a12c8fd7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.798234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8db5a-d683-4fb6-af71-cecb080ee21e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:17.839169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:17.839786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.840103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.840592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.858948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 165/321] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:17.860076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:17.860370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:17.860881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:17.878899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:17.880169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:17.915276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:17.916948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:17.950582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:17.958029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 166/322] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:17.958029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:17.977120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.044763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 157/323] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:18.044763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.083191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae57f-9073-4bdb-84f5-d3565aac3259 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.118664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.119270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.119552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.119825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.120568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] RBAC: Adding query filter params (group.id=9539100edfdd4ceb8ede5fde80028853, role.id=82925f6f46954c11888eaaf2678ac2e1, scope.project.id=f62a2c2b9817413184cb7c2cc540ae13) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:18.120877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.122311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.135911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 167/324] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Oct 17 02:59:17 2022] GET /identity/v3/role_assignments?group.id=9539100edfdd4ceb8ede5fde80028853&scope.project.id=f62a2c2b9817413184cb7c2cc540ae13&role.id=82925f6f46954c11888eaaf2678ac2e1 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.135911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.159104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b7f56-1bc0-42cf-88b5-35e56dcd5e7f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.202990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.203689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.204007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.204280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.205508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.206445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.207063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.208986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 158/325] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.216995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.234573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.262436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bebc47-5921-4e56-bfb9-86d3bcb2ea49 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.299228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.299890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.300172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.300437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] PATH_INFO: `/v3/projects/26800e77f5d7408c83ef840f5d2f30ea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.301610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] RBAC: Authorizing `identity:get_project(project_id=26800e77f5d7408c83ef840f5d2f30ea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.303080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.310042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 168/326] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/projects/26800e77f5d7408c83ef840f5d2f30ea => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.310042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.342003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e67c52-97c4-4a33-81eb-fff20c431ecc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.381492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.382122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.382402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.382678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.383785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.385274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.386851 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 159/327] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.387643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.431170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7a29c-551f-4b78-8c25-512b171f2b5e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.464411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.474263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.475756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.476220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.476498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.488909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:18.493462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:18.495612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:18.496511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:18.497401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 169/328] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:18.498043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.519136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9127a-58e3-4916-89a2-33c9506efda4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.557629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.558265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.558548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.559188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] PATH_INFO: `/v3/groups/9539100edfdd4ceb8ede5fde80028853` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.559991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] RBAC: Authorizing `identity:get_group(group_id=9539100edfdd4ceb8ede5fde80028853)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.561445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.563191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 160/329] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/groups/9539100edfdd4ceb8ede5fde80028853 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.563770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.608706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039792d-ae1e-4d55-9022-73b252862da8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.641893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.642681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.642958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.643230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.643971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] RBAC: Adding query filter params (group.id=9539100edfdd4ceb8ede5fde80028853, role.id=ab9c3b4062604fe89c73ebd5acc431c7, scope.project.id=26800e77f5d7408c83ef840f5d2f30ea) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:18.644278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.645712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.651796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 170/330] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/role_assignments?group.id=9539100edfdd4ceb8ede5fde80028853&scope.project.id=26800e77f5d7408c83ef840f5d2f30ea&role.id=ab9c3b4062604fe89c73ebd5acc431c7 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.652597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.662496 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce68d99-40a6-41d8-95ce-01c26ac6a17d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.702521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.703251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.703538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.703850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.704568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:18.704873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.706284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.720897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 161/331] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.722311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:18.730505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.736860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:18.788705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1cbfd-2e77-4eb9-9521-bd9f7452beef None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.824656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.825261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.825532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.825801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.826518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] RBAC: Adding query filter params (group.id=9539100edfdd4ceb8ede5fde80028853, role.id=82925f6f46954c11888eaaf2678ac2e1, scope.project.id=26800e77f5d7408c83ef840f5d2f30ea) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:18.826821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.828332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.835308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 171/332] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/role_assignments?group.id=9539100edfdd4ceb8ede5fde80028853&scope.project.id=26800e77f5d7408c83ef840f5d2f30ea&role.id=82925f6f46954c11888eaaf2678ac2e1 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:18.839587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db2bc4-845c-4f4b-b5df-ce2e8e91f676 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:18.882963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:18.883511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:18.883795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:18.884105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:18.972444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:18.974572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:18.988225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:19.084811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 162/333] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 17 02:59:19.090409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:19.192536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169b11-28d4-4e2a-9d16-14f32bc620c3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:19.211617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:19.229506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:19.230129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:19.230411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:19.230685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] PATH_INFO: `/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:19.231782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee3c4f2dfdc417cadc7f4d4979df81a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:19.233242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:19.234858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 172/334] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 02:59:19 2022] GET /identity/v3/projects/7ee3c4f2dfdc417cadc7f4d4979df81a => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:19.240430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:19.334439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d925fca-46e8-465a-8143-bd9394556f05 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:19.344683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:19.367953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0b0a3-d0a0-4f91-b472-8995b99ff188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:19.368568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b0a3-d0a0-4f91-b472-8995b99ff188 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:19.368849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b0a3-d0a0-4f91-b472-8995b99ff188 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:19.369122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0b0a3-d0a0-4f91-b472-8995b99ff188 None admin] PATH_INFO: `/v3/groups/b2e0fd1057854f5bbc39db11075f7f08` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:19.370215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0b0a3-d0a0-4f91-b472-8995b99ff188 None admin] RBAC: Authorizing `identity:get_group(group_id=b2e0fd1057854f5bbc39db11075f7f08)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:19.371652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0b0a3-d0a0-4f91-b472-8995b99ff188 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:19.373237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 163/335] 10.222.0.20 () {56 vars in 1180 bytes} [Mon Oct 17 02:59:19 2022] GET /identity/v3/groups/b2e0fd1057854f5bbc39db11075f7f08 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:19.378869 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:19.473807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897237-497f-403f-91d4-e98f22be7746 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:19.506055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:19.506694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:19.506976 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:19.507249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:19.507980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] RBAC: Adding query filter params (group.id=b2e0fd1057854f5bbc39db11075f7f08, role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=7ee3c4f2dfdc417cadc7f4d4979df81a) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:19.508288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:19.509702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de38a9a-c730-44a6-a761-23ec085ff219 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:19.515205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 173/336] 10.222.0.20 () {56 vars in 1376 bytes} [Mon Oct 17 02:59:19 2022] GET /identity/v3/role_assignments?group.id=b2e0fd1057854f5bbc39db11075f7f08&scope.project.id=7ee3c4f2dfdc417cadc7f4d4979df81a&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:22.017429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e61a17-73e0-4b48-a05c-cfcd2d375d37 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.017955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e61a17-73e0-4b48-a05c-cfcd2d375d37 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.018039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e61a17-73e0-4b48-a05c-cfcd2d375d37 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.019462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 164/337] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:22.039670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b9f7-7e00-4e40-a866-948016d9e0d6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.039670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b9f7-7e00-4e40-a866-948016d9e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.039670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81b9f7-7e00-4e40-a866-948016d9e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.060984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bf81b9f7-7e00-4e40-a866-948016d9e0d6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:22.062612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bf81b9f7-7e00-4e40-a866-948016d9e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:22.117367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:22.150422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 174/338] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:22.459166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fda2-8b43-4b62-95d6-d887cc1ab909 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.459580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fda2-8b43-4b62-95d6-d887cc1ab909 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.459781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233fda2-8b43-4b62-95d6-d887cc1ab909 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.461413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 165/339] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:22.466619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b535b9-fbb6-45fa-93a9-f15df03d96b5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.466910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b535b9-fbb6-45fa-93a9-f15df03d96b5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.467186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b535b9-fbb6-45fa-93a9-f15df03d96b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.492987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d3b535b9-fbb6-45fa-93a9-f15df03d96b5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:22.494226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d3b535b9-fbb6-45fa-93a9-f15df03d96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:22.542470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fda2-8b43-4b62-95d6-d887cc1ab909 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:22.583811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 175/340] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:22.639828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad11b-6d3b-4ed3-af65-b688f3f94a33 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.640497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad11b-6d3b-4ed3-af65-b688f3f94a33 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.640974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ad11b-6d3b-4ed3-af65-b688f3f94a33 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.642608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 176/341] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:22.648254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc9401-9558-43e1-9569-f0506ca6e904 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.648543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc9401-9558-43e1-9569-f0506ca6e904 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.648818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc9401-9558-43e1-9569-f0506ca6e904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.688877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-edfc9401-9558-43e1-9569-f0506ca6e904 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:22.690070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-edfc9401-9558-43e1-9569-f0506ca6e904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:22.701749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233fda2-8b43-4b62-95d6-d887cc1ab909 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:22.739459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:22.740535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.741317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.741809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.753166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:22.754905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:22.772436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:22.773469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:22.774357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:22.774357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:22.774357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:22.776938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 166/342] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:22.782442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:22.845172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:22.852619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 177/343] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:22.895319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404438-b847-4c5f-a71e-99786b5e8e61 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.895650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404438-b847-4c5f-a71e-99786b5e8e61 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.895897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f404438-b847-4c5f-a71e-99786b5e8e61 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.897934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 178/344] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:22.905285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.905502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.905781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.927593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433e0ed-86a0-481f-8e96-f6d62ea84bce None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:22.950385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:22.951585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:22.976012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:22.976971 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:22.977515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:22.978012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:22.978890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:22.979391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:22.981119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:22.995365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.000879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 167/345] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:23.002731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.036805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 179/346] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:23.037767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.096946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.107930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd15def-482e-4234-ae35-3da6c023e02d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.144891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.145876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.146362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.146844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.158494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.159998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:23.175515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:23.176483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:23.177355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:23.177355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:23.177355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:23.177355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 168/347] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:23.182845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.212429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960da24d-bd47-4e66-8613-8b4c93ee7de8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.250412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.251804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.251804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.251804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.252279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.253880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.288029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 180/348] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:23 2022] POST /identity/v3/users => generated 246 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:23.288029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.314356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00df0c7-59ad-4172-a56e-f023d36228c9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.342342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.385154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.385813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.386158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.386437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.398728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.400425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.408290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:23.419182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:23.420395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:23.426807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:23.426807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:23.426807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:23.426807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 169/349] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:23.426807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.468924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7061f94-ecf1-4edc-bcec-432a08876322 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.513021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365391-6503-445e-8031-81ec466683af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.513875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365391-6503-445e-8031-81ec466683af None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.514322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365391-6503-445e-8031-81ec466683af None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.514594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b365391-6503-445e-8031-81ec466683af None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.515249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365391-6503-445e-8031-81ec466683af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:23.515551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365391-6503-445e-8031-81ec466683af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.516981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b365391-6503-445e-8031-81ec466683af None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.530142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 181/350] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:23.532018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365391-6503-445e-8031-81ec466683af None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.543707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b22c0-a10f-4efc-832d-8b8bfa76566e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.586809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.587508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.587910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.588198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.601508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.603597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:23.622579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:23.623633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:23.625248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:23.625248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:23.625248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:23.625248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 170/351] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:23.625248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.648892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.666395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b365391-6503-445e-8031-81ec466683af None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.679939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.703420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.704140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.704425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.704707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.705343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:23.705649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.707025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.719400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 182/352] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:23.720259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.738647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74c10-2ac5-453e-b996-c4634d33e855 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.777107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18d19f-4a2c-460b-8d16-2b074fa271d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.777572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d19f-4a2c-460b-8d16-2b074fa271d5 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.777860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d19f-4a2c-460b-8d16-2b074fa271d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.778131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18d19f-4a2c-460b-8d16-2b074fa271d5 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.778791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18d19f-4a2c-460b-8d16-2b074fa271d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.780226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18d19f-4a2c-460b-8d16-2b074fa271d5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.804231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 171/353] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:23 2022] POST /identity/v3/users => generated 248 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:23.805955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a614-5bb1-46ec-9345-3568e6aa5d23 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.806524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a614-5bb1-46ec-9345-3568e6aa5d23 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.807397 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a614-5bb1-46ec-9345-3568e6aa5d23 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.809558 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 172/354] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:23.810555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a614-5bb1-46ec-9345-3568e6aa5d23 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:23.832944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516720b-d377-4f04-9dd3-22bb23f64a26 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.882861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:23.883831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.884274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.884819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.885721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:23.886275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:23.888081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dadbb-9ce4-4dc0-9959-c29fa0d7fb2f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:23.903582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 183/355] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:23.905244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:23.905716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:23.906171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:23.914858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.930767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:23.932542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:23.957956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a614-5bb1-46ec-9345-3568e6aa5d23 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:23.959660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:23.999654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:24.000712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:24.001001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:24.001280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:24.002023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:24.003463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:24.026982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 173/356] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:23 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:24.027924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:24.029229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 184/357] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:24.153313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede07b-1ac6-4a0c-92f7-ff9ae99e13c8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:24.191407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:24.192322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:24.192763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:24.193284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:24.194736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:24.196434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:24.223035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 174/358] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:24 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:24.320118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:24.437601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b17c-9cfc-4059-abaf-012c8323c6c9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:24.476497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:24.477108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:24.477389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:24.477662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:24.478337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:24.479702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:24.483189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:24.492087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 02:59:24.492087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 17 02:59:24.492087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [parameters: {'id': '4eecdcc7dd7041fd861564c1fdc7bdf2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 17 02:59:24.492087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Oct 17 02:59:24.509007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return ref.to_dict() Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 02:59:24.509932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 02:59:24.510884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 02:59:24.511742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 02:59:24.513253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 02:59:24.514042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'id': '4eecdcc7dd7041fd861564c1fdc7bdf2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:24.514824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 17 02:59:24.515623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:24.522653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 185/359] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Oct 17 02:59:24 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:24.522876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:24.550172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:24.666201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150c164-c300-4251-8d5b-a2e164201e10 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:24.717478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96d831-0f64-487e-94ea-c2f2c0b2763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:24.718488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d831-0f64-487e-94ea-c2f2c0b2763e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:24.719000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d831-0f64-487e-94ea-c2f2c0b2763e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:24.719505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96d831-0f64-487e-94ea-c2f2c0b2763e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:24.736778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96d831-0f64-487e-94ea-c2f2c0b2763e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-fb96d831-0f64-487e-94ea-c2f2c0b2763e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:24.743528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:24.744478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 17 02:59:24.745288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:24.747596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 175/360] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:59:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:24.757495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:24.919899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f880733-be7d-4682-9e7d-de1cc8722a5f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:24.961880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:24.962510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:24.962790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:24.963066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:24.963742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:24.964074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:24.965567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f1e70-03ea-42b0-99ae-756b73961afc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:24.975707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 186/361] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:25.879803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbd8a-320b-481a-9f33-93fbd57c6d49 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:25.880910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbd8a-320b-481a-9f33-93fbd57c6d49 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:25.881463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedbd8a-320b-481a-9f33-93fbd57c6d49 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:25.883033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 176/362] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:25.893739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f09e-363e-47d1-be3d-cd854cfd2c57 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:25.894205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f09e-363e-47d1-be3d-cd854cfd2c57 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:25.894278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2f09e-363e-47d1-be3d-cd854cfd2c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:25.936079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-98e2f09e-363e-47d1-be3d-cd854cfd2c57 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:25.937268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-98e2f09e-363e-47d1-be3d-cd854cfd2c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:26.022495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:26.035139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 187/363] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:26.533740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fc8c3-dc46-4b81-81dc-865751ae444f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:26.534113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fc8c3-dc46-4b81-81dc-865751ae444f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:26.534312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fc8c3-dc46-4b81-81dc-865751ae444f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:26.535911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 177/364] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:26.553743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:26.554379 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:26.554851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:26.557272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fc8c3-dc46-4b81-81dc-865751ae444f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:26.580343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:26.581881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:26.636460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:26.663244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fc8c3-dc46-4b81-81dc-865751ae444f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:26.710270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:26.710920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:26.711197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:26.711468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:26.717394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 188/365] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:26.726489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:26.731960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:26.732919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:26.734169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 178/366] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:26.739416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:26.866955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75a0c5-b4f5-401f-a29d-cc4ef4b5fc13 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:26.889562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:26.905883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:26.906649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:26.906816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:26.907021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:26.907691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:26.908021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:26.909397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eec6b-93a3-42f4-8518-362e69150af4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:26.927138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 189/367] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:26.932686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:26.948343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a876c59-decc-4f1c-8e76-17e45ee26386 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:26.948661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a876c59-decc-4f1c-8e76-17e45ee26386 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:26.948881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a876c59-decc-4f1c-8e76-17e45ee26386 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:26.950218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 190/368] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:26.959039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179549c9-70cc-4b4c-ac10-8befca151f78 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:26.959386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179549c9-70cc-4b4c-ac10-8befca151f78 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:26.959666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179549c9-70cc-4b4c-ac10-8befca151f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:26.982059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-179549c9-70cc-4b4c-ac10-8befca151f78 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:26.983290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-179549c9-70cc-4b4c-ac10-8befca151f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:27.069380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2eb93-3f73-47ad-b667-0a7ea715ce25 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.092091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 191/369] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:27.093389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553683-362d-4e54-8d9d-1f52317b394b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.093672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553683-362d-4e54-8d9d-1f52317b394b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.093940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89553683-362d-4e54-8d9d-1f52317b394b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.095484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 192/370] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:27.098333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553683-362d-4e54-8d9d-1f52317b394b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.111886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32758330-c634-460d-b817-658f8084a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.112529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758330-c634-460d-b817-658f8084a301 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.112850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758330-c634-460d-b817-658f8084a301 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.113117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758330-c634-460d-b817-658f8084a301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.116741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.126520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758330-c634-460d-b817-658f8084a301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:27.127273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758330-c634-460d-b817-658f8084a301 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-32758330-c634-460d-b817-658f8084a301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:27.145687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:27.146658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:27.147599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:27.147599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:27.147599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:27.151946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 179/371] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:27.155180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.155466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.155741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.179055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:27.180775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:27.227086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89553683-362d-4e54-8d9d-1f52317b394b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.245709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.259861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 180/372] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:27.261770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.278491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.280566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.281679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.282341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.303969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:27.309643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:27.310542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:27.311324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:27.317563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 193/373] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:27.323365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.439648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8ffce-3be6-423d-b702-31e77ae7737d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.460350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.481527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.482551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.483040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.483533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.484402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:27.484629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd81e4-284c-41eb-b515-bf76edc870ed None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.485131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:27.486891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:27.500162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 181/374] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:27.501301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.528347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.529433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.529928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.530397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.531366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:27.531937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:27.533511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:27.542965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 194/375] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:27.544033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.581344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.629446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c8091-f10f-40ea-a4d2-815b00deef56 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.657354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4134ce15-28ba-4e71-9fd1-36c1d83ab6ec None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.668468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.669196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.669540 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.669884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.684782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:27.690237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:27.691299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 182/376] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:27.692405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.696632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.697285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.697552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.697825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.705602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:27.707091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:27.719302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:27.720272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 195/377] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:27.721480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.731581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.795771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3d5bc-448b-4a41-8936-488fc4646229 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.813087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.820526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e9ed6-da0c-42db-9c05-d6ffcea93b77 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.828498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92858895-0410-4069-a7be-2dbe27cc670d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.829118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92858895-0410-4069-a7be-2dbe27cc670d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.829397 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92858895-0410-4069-a7be-2dbe27cc670d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.829668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92858895-0410-4069-a7be-2dbe27cc670d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.839486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92858895-0410-4069-a7be-2dbe27cc670d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-92858895-0410-4069-a7be-2dbe27cc670d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:27.844712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:27.845666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 183/378] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:27.852292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073795f-f471-4914-bcf3-433eee84e9e9 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.853105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073795f-f471-4914-bcf3-433eee84e9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.853105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073795f-f471-4914-bcf3-433eee84e9e9 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.853105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 184/379] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:27.853105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073795f-f471-4914-bcf3-433eee84e9e9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.857975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.858610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.858890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.859159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.869926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:27.871400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:27.886494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:27.887565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:27.888520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:27.888520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:27.888520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:27.888520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 196/380] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:27.888751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:27.949062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:27.957783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073795f-f471-4914-bcf3-433eee84e9e9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.989813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790224-1721-4506-b156-2f996d473e1d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:27.992270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:27.992889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:27.993164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:27.993429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:27.994077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:27.994374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:27.995733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.003978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 185/381] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.004751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.026194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.026798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.027077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.027351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.028098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.028405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.029842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2502-8ee6-4cad-a9d6-a3908a8b7309 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.065312 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 197/382] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Oct 17 02:59:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.066652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.066940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.067214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.074073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.086284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:28.087475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:28.103289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6fc33-b979-4f18-b0e5-f961132b3621 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.137812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.138415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.138695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.138967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.139672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.140021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.141398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.149688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 186/383] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.160091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 198/384] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:28.160235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.160326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.183408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.258034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce32b81-d388-4178-a27d-2638fa5bee03 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.265004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245d74d-c49f-4841-b7d4-79829c91dbd7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.299597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.300236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.300513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.300782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.301411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.301739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.303514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.303632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.304435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.305172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.306112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.308296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.320693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 187/385] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.320693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.323182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.324736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:28.342929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:28.343830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:28.345125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:28.345125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.345125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:28.345125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 199/386] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:28.345125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.406382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.428638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e41d-e189-4a4b-aff1-f938a4b79136 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.451240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972f7a-8ee7-476d-9d7f-4db232086430 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.462206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.462815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.463092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.463357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.472937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.474368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.483621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.484180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.484457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.484726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:28.488641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:28.489573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:28.490423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:28.490423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.490423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:28.490423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 188/387] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:28.490633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.497724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.499155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:28.513714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:28.514588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:28.515441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:28.515441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.515441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:28.515441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 200/388] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:28.515659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.553470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.595265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aa98-648e-4c41-ac95-b503ea4ad19f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.612996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6295bd-bf2d-4f32-92a3-8353ff27c600 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.624996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.632858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.633476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.633755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.634023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.641354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.642779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.647500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.648127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.648409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.648679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.649308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.649606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.650959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:28.655365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:28.656274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:28.657163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 189/389] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:28.657739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.670397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 201/390] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.670397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.755763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd347f-55bb-487a-b43d-d10f2d21d1f4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.760083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.763942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e116291-f8f5-4fb6-bfbd-c83c283bdc58 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.788605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.789224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.789502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.789772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.796614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.797217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.797501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.797777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.798414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.798716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.800079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.800177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.801509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.811393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 202/391] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.812204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:28.815919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:28.816857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:28.817702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:28.817702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:28.817702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:28.820128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 190/392] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:28.820982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.864100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.915431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f71e1c-734c-4a67-8a88-c7144c02eeec None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.918139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f937264-f5d3-4b6d-872b-c67fb20836a0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:28.949518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.950114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:28.950205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.950276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:28.950552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.950648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:28.950728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.950796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:28.951324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.951424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:28.951618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.951715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:28.953091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.953186 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:28.965612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 203/393] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.966620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:28.984815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:28.992208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 191/394] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:28.992968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.065606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726d74-abec-4b2e-ae4d-7742dc42ced5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.092168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2324-070f-4e9f-9799-7df019957a30 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.093679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.098758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.099373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.099649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.100011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.106882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.108518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:29.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:29.121890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 204/395] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:29.122778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.130664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.131804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.132109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.132380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.138874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.140359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:29.151520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:29.152412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:29.153297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:29.156174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 192/396] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:29.157001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.200383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.221456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102a39b-ab4e-4bc1-8290-ac45672131aa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.253864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f71d17-2c80-4215-9ccf-8c3656974347 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.254977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.255571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.255848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.256683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.257333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:29.257631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.258981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.270211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 205/397] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:29.274985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.292768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.293385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.293664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.293931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.301097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.302521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:29.313326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:29.314394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 193/398] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:29.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.338949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.372186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fabe89-02ed-4e9c-a9fe-aab6f8520c2f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.405351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.405968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.406249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.406524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.413400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.413512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba5008-6b1a-4f56-a100-0bb7164d441f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.417598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.419202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:29.434361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:29.435359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:29.436605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:29.436605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:29.436605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:29.436605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 206/399] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:29.436605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.448345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.448941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.449217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.449483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.450197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:29.450499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.451935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.468628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 194/400] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:29.469406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.534277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ba3e6-e0ab-47a0-8870-d099452814d2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.548407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.567184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.567710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.568021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.568292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.568381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e41a-73bc-4b38-92e8-2f09e43e7b33 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.569031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:29.569328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.570756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.588261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 207/401] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:29.589081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.606812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.607410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.607687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.607986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.608617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.610035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.630731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 195/402] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:29 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:29.631612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.652530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.709677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35448f-fa54-4c23-8043-e77d2e2a1ab8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.745627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40aff4-a40b-4bb2-a84c-e3a0f067f0a7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.750530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.751153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.751435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.751704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.752474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:29.752781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.754248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.774874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 208/403] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:29.775660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.788757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.789385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.789669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.789943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.790599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:29.790905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.792361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.796176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.813580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 196/404] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:29.814500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.884065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986a371-76dd-40fc-8a90-d8a22f2c9c6e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.894259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:29.921493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.921717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f28e-a524-42c6-93a8-31dd16d13fd1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:29.922172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.922461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.922735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.933934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.935392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:29.953040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:29.953977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:29.954849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:29.954849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:29.954849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:29.954849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 209/405] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:29.955564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:29.965181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:29.965854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:29.966128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:29.966399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b7b1497b5e4e4f77a92eba0c3d3b1cac/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:29.981386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=b7b1497b5e4e4f77a92eba0c3d3b1cac, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:29.982751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.007903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 197/406] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:29 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b7b1497b5e4e4f77a92eba0c3d3b1cac/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:30.007903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.062757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.112338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a05ef8-3ee0-4434-821c-3744a157c834 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.132924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26cfa2-7176-43b8-a302-8697b2fb4e42 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.155626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.156232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.156512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.156777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.168902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.170384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.173569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.174212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.174491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.174824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.183419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.185063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:30.187069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:30.187994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:30.188842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:30.188842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:30.188842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:30.188842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 210/407] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:30.190009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:30.198295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:30.199221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:30.200110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 198/408] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:30.200570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.214134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.307339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29263fc1-1a56-4835-935e-3c8021a5f02d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.317305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bc626-dd0b-4cc6-911d-0380cca3caa8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.317860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.342470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.343076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.343359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.343632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.344300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:30.344605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.345980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.359026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.359713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 199/409] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:30.359825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.360219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.360614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.360736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.361372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:30.361740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.363183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.380254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 211/410] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:30.382021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.464941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.479305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f7b1c-81c3-4595-bf2e-9383572ef77a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.499908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6b629-608d-4faf-a8f6-eeb83fc7e09f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.514038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.514648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.514931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.515206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.515924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:30.516239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.517746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.536464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 200/411] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:30.537660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.540668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.541768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.542285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.542760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.551633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.554284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.567457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:30.569533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:30.570695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:30.571540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:30.573829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 212/412] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:30.575343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.643011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20336e36-2f6d-421a-a3c4-9a1389d69a8e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.678177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.678806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.679090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.679364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.686421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.688092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.691298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b06c3-5b48-4b9b-9391-943ef339bd38 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:30.699683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:30.700590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:30.701490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 201/413] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:30.701947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.727208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.733760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.734635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.735161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.735606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/6eb1916e113843f6a02c8b80c33b1532/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.755092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=6eb1916e113843f6a02c8b80c33b1532, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.757321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.772799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 213/414] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:30 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/6eb1916e113843f6a02c8b80c33b1532/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:30.773685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.792733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:30.817132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde70453-5697-4cb6-a579-4f9852308060 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.890201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.891247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.891738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.892261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.893176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:30.893690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.895383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.904934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9737ae-53cb-4ecb-ae43-839e48946a4c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:30.911956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 202/415] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:30.922228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:30.957527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:30.957527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:30.957527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:30.957527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:30.957934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:30.957934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:30.960812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:30.980300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 214/416] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:30.981108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:31.035653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:31.065187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a75edf-c03b-4ec7-97b1-8495bf9b7774 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:31.108524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3cdd-5e20-4b7a-9024-e8607d57faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:31.109534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3cdd-5e20-4b7a-9024-e8607d57faf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:31.110044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3cdd-5e20-4b7a-9024-e8607d57faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:31.110519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3cdd-5e20-4b7a-9024-e8607d57faf2 None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b4351f9211b24b91b2521d717905dbbe/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:31.129111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3cdd-5e20-4b7a-9024-e8607d57faf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=b4351f9211b24b91b2521d717905dbbe, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:31.130868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3cdd-5e20-4b7a-9024-e8607d57faf2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:31.136054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:31.154824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 203/417] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:30 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b4351f9211b24b91b2521d717905dbbe/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:31.156399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69958-40ff-403a-ada7-62c6d00daaca None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:31.196197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251b48-d18d-4f1d-b583-09d1ac7a6a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:31.197273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251b48-d18d-4f1d-b583-09d1ac7a6a94 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:31.197751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251b48-d18d-4f1d-b583-09d1ac7a6a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:31.198324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251b48-d18d-4f1d-b583-09d1ac7a6a94 None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/315ab129549044d2bce148bb55dc63ed/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:31.215651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251b48-d18d-4f1d-b583-09d1ac7a6a94 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=315ab129549044d2bce148bb55dc63ed, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:31.217561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251b48-d18d-4f1d-b583-09d1ac7a6a94 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:31.236680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 215/418] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:30 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/315ab129549044d2bce148bb55dc63ed/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:32.031149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a004c-122e-4cf2-8762-e137a81e0bba None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:32.031465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a004c-122e-4cf2-8762-e137a81e0bba None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:32.031703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a004c-122e-4cf2-8762-e137a81e0bba None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:32.033316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 204/419] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:32.038799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0a46e-a68b-46b8-b6ec-96c6b4e92961 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:32.039092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0a46e-a68b-46b8-b6ec-96c6b4e92961 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:32.039374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0a46e-a68b-46b8-b6ec-96c6b4e92961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:32.065421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7cf0a46e-a68b-46b8-b6ec-96c6b4e92961 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:32.066630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7cf0a46e-a68b-46b8-b6ec-96c6b4e92961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:32.165077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 216/420] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:32.479036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a004c-122e-4cf2-8762-e137a81e0bba None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:32.611582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a004c-122e-4cf2-8762-e137a81e0bba None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:32.647689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:32.648341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:32.648625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:32.648896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:32.658975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:32.664385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:32.665275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:32.666513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:32.667500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414423be-ac69-4ed7-9097-5d26d0893fcf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:32.667500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414423be-ac69-4ed7-9097-5d26d0893fcf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:32.667500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414423be-ac69-4ed7-9097-5d26d0893fcf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:32.667687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 205/421] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:32.667759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 217/422] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:32.671603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:32.672263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:32.672546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:32.672823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:32.724957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:32.726150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:32.740877 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:32.775461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81695c0f-b7ad-4df6-a3bd-a02dfaa6306f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:32.777478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:32.815391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:32.816336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:32.817225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:32.817710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:32.818606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:32.819092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:32.820973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:32.829607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 206/423] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:32.836432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:32.904828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 218/424] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:32.986144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466407-ec47-4f91-b2d3-71d2446d08f4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.010892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:33.033032 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.034027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.034515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.034979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.055427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:33.057194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:33.081047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:33.081941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:33.082772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:33.082772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:33.082772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:33.084881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 207/425] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:33.090534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.217771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e587f0-dbd2-4d56-a864-a931b92753a9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.253724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.254336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.254622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.254899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.255540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:33.255844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:33.257767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:33.269796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 219/426] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:33.275122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.299830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.320937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:33.422672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26fc6f-b2aa-4fb6-abf5-89b9479770f7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.464664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.466149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.466716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.467204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.476975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:33.479010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:33.493562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:33.494936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:33.495838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:33.498674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 208/427] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:33.504990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.514707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f2a40-2c96-4a9e-bfc3-f707c13eab8b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.556390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:33.564600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20315b2-99ba-4126-9477-e87f7746de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.565244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20315b2-99ba-4126-9477-e87f7746de84 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.565524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20315b2-99ba-4126-9477-e87f7746de84 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.565797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20315b2-99ba-4126-9477-e87f7746de84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.596486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20315b2-99ba-4126-9477-e87f7746de84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b20315b2-99ba-4126-9477-e87f7746de84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:33.602547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:33.603489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:33.604319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 220/428] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:33.605006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85fad-a6db-48d3-8cb9-b1a894661837 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.605077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85fad-a6db-48d3-8cb9-b1a894661837 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.606012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c85fad-a6db-48d3-8cb9-b1a894661837 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.606785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 221/429] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:33.611634 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85fad-a6db-48d3-8cb9-b1a894661837 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.638100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4b72a-d6e9-437e-9b15-02d7d2ca9e09 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.674292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.675244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.675757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.676265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.677228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:33.677731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:33.679976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d96c44-3d71-4260-b6fd-7a9f8edf9287 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:33.698275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 209/430] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:33.699733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:33.701032 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.701318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.701591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.724420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:33.726325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:33.731651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c85fad-a6db-48d3-8cb9-b1a894661837 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.770243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.770844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.771268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.771681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.773043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:33.773404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:33.774825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:33.783805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 222/431] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:33.789633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.807823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 210/432] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:33.808822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:33.843777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:33.895614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163afb7-c7e8-4eee-9a71-e50676889628 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.930538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:33.931271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.931612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.931972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.934069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:33.944372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:33.945924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:33.954284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ef2db-81d1-4b8e-84a2-94d7179ddd8f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-60924b4f-9113-450b-9ebc-7dd7ee5dc209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:33.970789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:33.971828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:33.972741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:33.972741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:33.972741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:33.974925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 223/433] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:33.976528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d3000-95de-4fe6-b57d-15a541987464 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:33.977158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d3000-95de-4fe6-b57d-15a541987464 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:33.977632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d3000-95de-4fe6-b57d-15a541987464 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:33.983782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 224/434] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:33.985461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d3000-95de-4fe6-b57d-15a541987464 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.000450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.001200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.001543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.001883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.013478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.015124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-45c2a35d-7d75-446b-b41b-993e9b9b2586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:34.030054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:34.030969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:34.031831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:34.031831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:34.031831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:34.035972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 211/435] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:34.037418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.037786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.038127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.056448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:34.057754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:34.104146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d3000-95de-4fe6-b57d-15a541987464 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.122078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.132012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 212/436] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:34.133815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.147201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.147818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.148127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.148396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.149349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:34.149662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.151045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d43503-3256-4261-a982-435b4340ee04 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.162955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 225/437] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:34.168359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf8ce-5c81-4187-ac02-711a3003f6da None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.168644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf8ce-5c81-4187-ac02-711a3003f6da None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.168915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf8ce-5c81-4187-ac02-711a3003f6da None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.170275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 226/438] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:34.170814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf8ce-5c81-4187-ac02-711a3003f6da None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.220418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.248108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512df0a7-1479-4a52-a854-7f238f4d64d4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.277475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf8ce-5c81-4187-ac02-711a3003f6da None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.283980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.284692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.284967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.285358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.286041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:34.286390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.288067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.300390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 213/439] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:34.306142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.312242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c95e5a-76cc-4227-8d50-f8d1b212e549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.312870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95e5a-76cc-4227-8d50-f8d1b212e549 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.313151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95e5a-76cc-4227-8d50-f8d1b212e549 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.313422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c95e5a-76cc-4227-8d50-f8d1b212e549 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.323772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c95e5a-76cc-4227-8d50-f8d1b212e549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-96c95e5a-76cc-4227-8d50-f8d1b212e549 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:34.328580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:34.329476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:34.330284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 227/440] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:34.330933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.331494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.331494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.348875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:34.350216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:34.375083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.415668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 228/441] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:34.416662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.418482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d142-66e3-4468-8956-38634bb97f9b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.451958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.452742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.453026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.453301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.459821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.461284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.465542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:34.472455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:34.473309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:34.474148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 214/442] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:34.474621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.539091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282f97-1f6f-4f98-90ec-408b41d84c7a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.574559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.575184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.575468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.575739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.582223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9b0f-349e-416a-81a1-8245d5a93a22 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.582665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.584162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:34.595654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:34.596579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:34.597467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 229/443] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:34.598023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.607851 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.625306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.625844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.626203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.626469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.627151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:34.627619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.629347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.642812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 215/444] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:34.642812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.704662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.711139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395c8fd-2ec5-493e-a391-ac9c07ef00ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.742842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd48c7-f085-40e3-b9c5-aa372522d4d3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.744246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.744871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.745151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.745427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.755236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:34.760983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:34.762030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 230/445] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:34.762836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.780778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.781387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.781666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.781937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.782627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:34.782929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.784391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.797475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 216/446] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:34.798258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.841719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.861329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e138b-b6e5-49a9-af5f-e31fbb3dd4c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.894460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.894987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.895267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.895538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.896284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:34.896741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.897268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922006fa-82ac-4569-915d-9b04f3191420 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:34.898179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.915480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 231/447] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:34.916300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:34.930951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:34.935559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:34.936269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:34.936545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:34.936823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:34.947313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:34.948921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:34.964488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:34.965390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:34.966425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:34.966425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:34.966425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:34.966425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 217/448] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:34.967043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.018026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf45a-77f5-4031-9ce8-a32a9ff82841 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.051067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.051679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.051988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.052260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.058407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.062497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:35.064958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41af8e-14e3-42f0-b976-a27822ee55fb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:35.067183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:35.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:35.068996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 232/449] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:35.069664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.098435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.099031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.099310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.099580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.100320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:35.100619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.101999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.109686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 218/450] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:35.110279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.151787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.177421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3952f-ee55-4f6d-a626-03b252c5ed5b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.206611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efe31e-6767-4b8f-83b2-4a814b93c390 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.210382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.211027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.211305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.211577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/eb1d31c2fdfe467ebbed5a3a46ab4325/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.225972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=eb1d31c2fdfe467ebbed5a3a46ab4325, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.227437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.239239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.239613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 233/451] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:35 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/eb1d31c2fdfe467ebbed5a3a46ab4325/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:35.239843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.240168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.240480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.240772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.269407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.319406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.320900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.367956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f58578-2c53-48a3-9f34-610ad0d95e20 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.393256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.407070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.407708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.408022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.408303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.409696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:35.410004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.411364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.424076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 234/452] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:35.425097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.438759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 219/453] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:35.439674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.498217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.543828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312fe7b-ec68-4297-a1a7-3f35fbb5f968 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.549435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203f4e-6b3f-46cf-9fa5-734974b3e281 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.578450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.579059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.579338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.579610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.580300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:35.580605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.581982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.588021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.589196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.589649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.590092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.590639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 235/454] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:35.591429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.605435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.607134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:35.624872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:35.626146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:35.627108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:35.627108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:35.627108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:35.628484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 220/455] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:35.633951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.642315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.698815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116824bd-693f-4679-a9ef-1747be9b7a2c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.735759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.736420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.736700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.736968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.743290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf61139-8976-4e0a-a403-ad3ac3dd7b9c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.744867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.746424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.753195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:35.757522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:35.758568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 02:59:35.759659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:35.763182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 236/456] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:35.763911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.783255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.784057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.784439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.784814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.796369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.797936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:35.815520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:35.816647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:35.822593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:35.822593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:35.822593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:35.822593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 221/457] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:35.822593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.870488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78862e39-4fc1-4c26-ab6a-f0c8df6013cd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.878311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:35.913598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.914496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.914776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.915045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.925389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.927266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.931217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077540df-07bc-45a9-8a72-807a590edd9d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:35.942727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:35.944425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:35.945289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:35.945289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:35.945289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:35.945289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 237/458] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:35.945289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:35.978529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:35.979142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:35.979423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:35.979697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:35.980493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:35.980912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:35.982274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:35.996774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 222/459] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:35.997633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.021219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.058146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a87d0-48af-4e63-91bc-4929376755bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.096265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.096892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.097175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.097451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.098219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:36.098526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.100613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.104856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1197f13-d0e7-417c-8ce3-42fb6f5c1bc9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.120163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 238/460] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:36.125433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.142332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.143442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.144214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.144523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.144897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.145609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:36.145957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.148088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.160277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 223/461] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:36.160895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.226260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f96ca0-220f-429d-849c-4afc56cfaece None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.245176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.263720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.264356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.264635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.264937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.265537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:36.265841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.267217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.267654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb178966-c7e7-436b-b5d8-b32f06607364 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.284731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 239/462] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:36.284731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.307686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.308289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.308567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.308898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.316753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.317857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:36.329016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:36.329908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 224/463] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:36.336349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.367913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.391581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac33e2-db86-4a1b-aaf2-02ff8c3b59fb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.428253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.428962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.429364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.429748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.441518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea7e53-5f98-410a-a0b8-f390d2265b3c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.475903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.476627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.476842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.477114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.483733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.485209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.488018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:36.498773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:36.499837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:36.500964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:36.504618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 225/464] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:36.505094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.505462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.507341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.582981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.607194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 240/465] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:36.608233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.616527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14ac86-8544-4d77-901f-571c34b34e98 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.651504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.652322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.652607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.652878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.665305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.666773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:36.678347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:36.679244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 226/466] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:36.680198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.713973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f4608-a97d-4482-a324-4b14a77c1a03 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.747957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.750424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.751278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.751492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.751801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.752588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:36.752894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.754305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.772050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 241/467] 10.222.0.20 () {56 vars in 1139 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:36.772877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.801374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80c204-aef2-4f1d-9a4c-034e2f936777 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.809072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:36.838025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.838870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.839152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.839419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.840138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:36.840439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.841845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.860326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 227/468] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:36.860326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.883102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fad33-f7e2-44fe-8ba7-9c282b9e9cd7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.921141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:36.921141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:36.921141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:36.921472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:36.931707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:36.933220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:36.949620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:36.950547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:36.951415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:36.951415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:36.951415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:36.951415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 242/469] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:36.951415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:36.976954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cadd3-6dfe-4323-8f71-21fa2fbc5f2c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:36.998226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.013266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.013871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.014148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.014417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.015142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:37.015440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.016880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.035588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 228/470] 10.222.0.20 () {56 vars in 1137 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:37.036706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.051392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.069551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabf566-df74-45b0-a2a1-a60ec2d878ef None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.109567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.110167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.110446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.110717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.141334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ddb9-1c93-493e-a3e6-1c3502b6c40a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.177981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.178587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.178866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.179136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.179855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=b7b1497b5e4e4f77a92eba0c3d3b1cac) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:37.180192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.180491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.181613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.181929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.195912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 229/471] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/role_assignments?user.id=b7b1497b5e4e4f77a92eba0c3d3b1cac&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:37.195912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.257432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.300079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.320687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 243/472] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:37.321620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.333841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6a477-5032-4378-b10e-bf54d7f174f1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.372928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.372928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.373182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.373431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.374102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:37.374464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.375803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.389346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 230/473] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:37.390169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.438044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad53f9-62b2-4c9b-9bdd-87d662cbb0f2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.477065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.477665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.477946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.478219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.495614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3842d03-50c7-4a87-8aa3-d16f8b05687e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.497177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.532301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.532869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.533149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.533418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.535467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.545450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.546903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.550281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.551725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-02643ae8-160e-455d-9922-554e5fceac21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:37.562585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:37.563511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:37.564860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:37.564860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:37.564860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:37.564860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 231/474] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:37.565640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2e157-cd05-406a-ae1f-d8f6a6a3b9d9 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.565919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2e157-cd05-406a-ae1f-d8f6a6a3b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.566189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2e157-cd05-406a-ae1f-d8f6a6a3b9d9 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.567554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 232/475] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:37.572623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2e157-cd05-406a-ae1f-d8f6a6a3b9d9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.669922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 244/476] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:37.669922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.684526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2e157-cd05-406a-ae1f-d8f6a6a3b9d9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.723500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.724304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.725155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.725430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.733233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.735555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b17bf251-857f-4038-b92e-a1ef9f6d1234 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:37.748858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:37.749740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:37.750600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:37.751007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 233/477] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:37.752217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.752499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.752772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.754760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.772595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:37.773589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d802779-6d7c-4b12-9a79-f67e9e8ab062 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.773785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:37.783296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:37.812689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:37.813331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:37.813610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:37.813936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:37.814616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:37.814919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:37.816312 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:37.829245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 245/478] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:37.831022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.844283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 234/479] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:37.845123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:37.969372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe63494-d808-447d-8cfb-e8ddd78353da None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:37.975587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a0e29-83a1-47db-a72d-f86acd62a4a0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.007428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.008075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.008353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.008621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.009303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.009601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.011132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.020997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.022698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.023173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.023655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.024475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 235/480] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.025292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.029677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.040223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.042422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.051212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:38.063741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:38.064673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:38.065642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:38.065642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:38.065642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:38.065642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 246/481] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:38.066298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.151477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b833b-a297-4364-aa8b-ad78f8726587 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.175402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef72003-1128-412f-91d2-4b243f60a22e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.188425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.189051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.189321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.189591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.196471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.197898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:38.208907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:38.209774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:38.210624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 236/482] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:38.211067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.213187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.214024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.214303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.214807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.215538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=6eb1916e113843f6a02c8b80c33b1532) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.215845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.217293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.231901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 247/483] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/role_assignments?user.id=6eb1916e113843f6a02c8b80c33b1532&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.231901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.301590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.314616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.348102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c35197-c7c1-4a4b-b4cf-58ff81c174d0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.371752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637e14-631e-4950-acce-7f1d5a93e5f5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.386327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.387064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.387408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.387741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.401646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:38.405940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:38.407010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:38.407993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:38.409909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 248/484] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:38.413619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.418631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.419268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.419557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.420380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.421033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.421336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.422703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.437507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 237/485] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.438350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.532314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee6f6-5d29-4798-9166-3315f7762198 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.553944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7072-f928-4659-a721-8e6857d3d707 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.555374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.567405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.567763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.568074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.568425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.569169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.569420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.570850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.582936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 249/486] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.588691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.592489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.596532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.597307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.597770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.598293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.600385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.600930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.602660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.612244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 238/487] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.613258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.700667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b3952-d984-4a47-91b3-e4db61a61a02 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.722352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af96e-7a62-4fb1-8834-8d427a16054c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.736459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.737089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.737372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.737646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.746303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.748209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.760738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.761580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.762003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.762416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.763306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=315ab129549044d2bce148bb55dc63ed) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.763805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.765430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:38.767007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:38.768056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:38.769070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:38.771940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 250/488] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:38.772897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.778086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 239/489] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/role_assignments?user.id=315ab129549044d2bce148bb55dc63ed&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.779040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:38.822410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.839087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:38.909263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e725b-9dfc-468f-8d70-929fb71a4ff9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.910587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce745d-58ee-4222-9d98-9bd57c0d25b9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:38.948769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.951827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.952387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.952856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.953739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:38.954249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.956358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:38.971579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 240/490] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:38.973188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:38.973836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:38.974118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:38.974394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:38.991139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:38.991798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:39.001264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:39.027417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:39.028387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:39.029235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:39.029235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:39.029235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:39.029235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 251/491] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:39.036323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:39.109560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4852fa-f503-4a14-83d8-470983b2e88c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:39.122127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:39.149481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:39.150504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.151030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.151536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:39.152490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=b4351f9211b24b91b2521d717905dbbe) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:39.152994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:39.154746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:39.161506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 241/492] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:38 2022] GET /identity/v3/role_assignments?user.id=b4351f9211b24b91b2521d717905dbbe&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:39.210918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:39.221182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b879d-294b-4117-8c8b-6b4826b7666f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:39.281769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:39.282859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.283422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.283910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:39.284765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:39.285264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:39.286924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad9ecf-28d4-4ff3-b0d3-d78993ee7bde None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:39.307186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 252/493] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:39.312824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:39.426759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085dd7c-9165-43d2-90cc-feca9531f469 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:39.463636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:39.464699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.465189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.465665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:39.468003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab42b7-c435-430a-b959-d07705689312 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.468543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab42b7-c435-430a-b959-d07705689312 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.469243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab42b7-c435-430a-b959-d07705689312 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:39.471657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 253/494] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:39.476773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:39.477359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.477841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.478237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:39.478705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:39.495377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:39.496412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:39.497395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:39.499092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 242/495] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:39.504688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:39.505379 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:39.506656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:39.545407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:39.582303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 254/496] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:39.627116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2aec8-f584-424c-af04-017fd31eca85 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:39.663191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:39.664062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.664487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.664901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:39.665770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:39.666238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:39.667806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:39.685905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 243/497] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Oct 17 02:59:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:39.691596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:39.820016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:39.841582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e0db-abf5-487d-91a5-a59f48a1725b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:39.884255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:39.899154 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154f47-feab-4176-933b-e381b377347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:39.900133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154f47-feab-4176-933b-e381b377347f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:39.900612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154f47-feab-4176-933b-e381b377347f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:39.901099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154f47-feab-4176-933b-e381b377347f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.044456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30154f47-feab-4176-933b-e381b377347f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:40.045913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30154f47-feab-4176-933b-e381b377347f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:40.075989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:40.093889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce223bf-0a36-4291-ac03-71b5e1ed9a96 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.158529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:40.159154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.159432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.159699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.184120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:40.188838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:40.189791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:40.190610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:40.191228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 244/498] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:40.204244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:40.205394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:40.229714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 255/499] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 17 02:59:40.233555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154f47-feab-4176-933b-e381b377347f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:40.372003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2765311-e603-4799-b8b2-a1209928f452 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.406854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:40.407462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.407739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.408131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.408765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:40.409064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:40.410418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:40.419484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 245/500] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:40.424818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:40.444290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:40.449086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154f47-feab-4176-933b-e381b377347f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.522031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:40.523206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.524042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.524773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.529192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c254918-f063-4689-b4b4-87bd45dfcf3d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.537983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:40.540062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:40.556333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:40.557710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:40.558579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:40.558579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:40.558579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:40.561038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 256/501] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:40.567919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:40.597306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:40.598274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.598750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.599215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.622158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:40.625731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:40.646934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:40.647995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:40.648862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:40.648862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:40.648862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:40.649114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:40.650834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 246/502] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:40.660639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:40.728254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:40.774745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc9c23-3dd4-499c-b784-9773f5c480c1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.788206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69807c5-dc4f-4a2a-85a3-b0e083779a24 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.811767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:40.812555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.812839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.813114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.813766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:40.814060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:40.815547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617e74f-0575-450d-adab-c468b1bef4b4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:40.823734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:40.824551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.824972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.825402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.826171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:40.826613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:40.828191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1525778-7094-4dad-9cd5-5ee0b0ec788f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:40.828543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 247/503] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:40.830084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a6b1c-6021-461e-be6d-8898c5e6ae74 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.830301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a6b1c-6021-461e-be6d-8898c5e6ae74 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.830580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a6b1c-6021-461e-be6d-8898c5e6ae74 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.836252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 248/504] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:40.837090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a6b1c-6021-461e-be6d-8898c5e6ae74 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:40.842362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 257/505] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:40.845624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:40.845909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:40.846183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:40.868200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:40.870078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:40.956462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a6b1c-6021-461e-be6d-8898c5e6ae74 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:40.970014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 258/506] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:40.970014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.007861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.016227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.025399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.025978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.026260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.026530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.041917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.043362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:41.062935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:41.063927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:41.064867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:41.072610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 249/507] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:41.077761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.108170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae16f9b-b09f-4964-a002-bb1000a49518 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.147114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.148144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.148666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.149114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.160048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.163330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:41.177908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:41.178774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:41.179656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:41.186812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 259/508] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:41.188475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.295156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.307324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5befcc-ddeb-4720-b32a-a24eabe756a4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.320199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433d74-05f5-4247-af73-c83f0aa01465 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.343249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.344084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.344270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.344533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.345250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:41.345550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.346982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.367065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.367449 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 250/509] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:41.368169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.368837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.369321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.369794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.370998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:41.371640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.374533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.399022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 260/510] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:41.399022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.440417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.508241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95d55-1856-412e-83fd-2af7d212b671 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.512702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d4084-fe45-4c40-b83a-f2ce471aac7d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.545927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.546472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.546743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.547011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.548815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.549758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.550062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.550368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.550957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.552355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.557426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.558838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:41.564946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:41.565911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:41.572695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 251/511] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:41.573521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1726d609-6797-4801-8d40-89ab583f3c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:41.573905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:41.575028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:41.575949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:41.575949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:41.575949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:41.576692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.580000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 261/512] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:41.581210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d05c-787e-4c80-b248-b6e8e9e7a39d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.581880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d05c-787e-4c80-b248-b6e8e9e7a39d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.582157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d05c-787e-4c80-b248-b6e8e9e7a39d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.583958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 262/513] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:41.588138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d05c-787e-4c80-b248-b6e8e9e7a39d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.679187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7158c24-53bc-4690-92c7-45b8bc57d73f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.689233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.695433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d05c-787e-4c80-b248-b6e8e9e7a39d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.719224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.720123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.720408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.720692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.721413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=eb1d31c2fdfe467ebbed5a3a46ab4325) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:41.721719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.723162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.729927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.730108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 252/514] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/role_assignments?user.id=eb1d31c2fdfe467ebbed5a3a46ab4325&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:41.730876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.730984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.731414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.731688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.732405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:41.732708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.734101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089547-4bc9-47c4-8970-dfd34e983415 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.749407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 263/515] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:41.749407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.749407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.749407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.765757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:41.767036 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:41.843167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:41.862841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 264/516] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:41.864149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:41.884009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4310c48-41ae-49b3-b9f1-3f2b63927503 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:41.932598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:41.933195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.933470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.933727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.934372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:41.934670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:41.936234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1abba-d560-42e6-ae95-0aaaaf0a0ae5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:41.956576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 253/517] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:41.957355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394af1c1-81eb-4a7f-ac5b-2879c41ff32f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:41.957640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394af1c1-81eb-4a7f-ac5b-2879c41ff32f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:41.957911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394af1c1-81eb-4a7f-ac5b-2879c41ff32f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:41.963659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 254/518] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:41.964453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394af1c1-81eb-4a7f-ac5b-2879c41ff32f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.005415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf52dee-3790-443b-bb48-c97e42870bc4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.006610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.046349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.047239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.047763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.048212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.049049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:42.049516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.051052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41221a49-7e66-400e-abb9-54b6557cdb10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.057747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 265/519] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:42.059218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.059659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.060109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.080710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:42.082205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:42.097549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394af1c1-81eb-4a7f-ac5b-2879c41ff32f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.143248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.146043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.146975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.147291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.147734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.157056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.158543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.166136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 266/520] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:42.167431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:42.178610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:42.179604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:42.180545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:42.183103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 255/521] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:42.189179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.340360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.353202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e380c-bdd9-4b24-8d31-95c08505aa78 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.356759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39756b1-c3cc-41b8-8bb8-bcf062938bc4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.395817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.397375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.397865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.398344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] PATH_INFO: `/v3/services/network` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.398612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.399228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.399510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.399741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.399850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.400550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:42.400860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.401816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.402263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.419895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 256/522] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:42.420076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:42.421006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:42.421834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 267/523] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:42 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:42.422626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.425001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.513127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.567713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654793a2-6617-4caf-82b4-f0261561328c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.576876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a92be4-bd16-4a3e-a505-2060e8b7db40 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.605998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.606578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.606859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.607446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b7b1497b5e4e4f77a92eba0c3d3b1cac/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.610135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=b7b1497b5e4e4f77a92eba0c3d3b1cac, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.611819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.621669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178876-9933-40be-bbb1-53bda854411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.622559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178876-9933-40be-bbb1-53bda854411c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.623204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178876-9933-40be-bbb1-53bda854411c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.623718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178876-9933-40be-bbb1-53bda854411c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.624660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178876-9933-40be-bbb1-53bda854411c None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:42.625345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178876-9933-40be-bbb1-53bda854411c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.627328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178876-9933-40be-bbb1-53bda854411c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.631794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 257/524] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:42 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b7b1497b5e4e4f77a92eba0c3d3b1cac/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:42.631794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.640497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 268/525] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 02:59:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:42.645787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178876-9933-40be-bbb1-53bda854411c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.646496 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.760408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb58e8-393b-4456-8f28-c194e6752b4b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.809742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.810402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.810686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.810974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.824196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.825755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:42.842480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:42.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:42.844387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:42.844387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:42.844387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:42.848080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 258/526] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:42.850680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:42.890605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178876-9933-40be-bbb1-53bda854411c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:42.907159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.924365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:42.938255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:42.939267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:42.939748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:42.940297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:42.941677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] RBAC: Adding query filter params (type=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:42.942231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:42.945062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:42.956255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 269/527] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 02:59:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:42.982680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49359581-79e8-4634-b6fa-8700dbfd4a80 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:43.040355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:43.040977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:43.041259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:43.041538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:43.042196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:43.042499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:43.043959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631d920-2e9c-4268-b0de-647e2f80dffd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:43.065347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 259/528] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:43.070957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:43.198462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c0544-88a4-4c97-873f-1af1be90235b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:43.234977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c0c6-90ec-452f-ab02-94e80cf2719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:43.235590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c0c6-90ec-452f-ab02-94e80cf2719d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:43.235887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c0c6-90ec-452f-ab02-94e80cf2719d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:43.236165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c0c6-90ec-452f-ab02-94e80cf2719d None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:43.236823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c0c6-90ec-452f-ab02-94e80cf2719d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:43.238265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c0c6-90ec-452f-ab02-94e80cf2719d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:43.263747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 270/529] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 02:59:43 2022] POST /identity/v3/users => generated 254 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:44.312021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d704a3-52a2-4607-a433-cc0fa381b879 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:44.313066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d704a3-52a2-4607-a433-cc0fa381b879 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:44.313581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d704a3-52a2-4607-a433-cc0fa381b879 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:44.315336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 260/530] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:44.321330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac514-7250-4cf9-aaaf-1e8f9adb2b1f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:44.322115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac514-7250-4cf9-aaaf-1e8f9adb2b1f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:44.322609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aac514-7250-4cf9-aaaf-1e8f9adb2b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:44.342028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-61aac514-7250-4cf9-aaaf-1e8f9adb2b1f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:44.343525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-61aac514-7250-4cf9-aaaf-1e8f9adb2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:44.372248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:44.418778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 271/531] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:44.573652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623c08e-040e-4cd1-bffa-cf25770dbea1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:44.573946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623c08e-040e-4cd1-bffa-cf25770dbea1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:44.574128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623c08e-040e-4cd1-bffa-cf25770dbea1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:44.575668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 261/532] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:44.581135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:44.581669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:44.582149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:44.605239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:44.606744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:44.698802 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 272/533] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 17 02:59:44.847686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623c08e-040e-4cd1-bffa-cf25770dbea1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:44.980747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623c08e-040e-4cd1-bffa-cf25770dbea1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:45.012886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:45.024468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:45.025094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.025373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.025643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.046503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:45.051793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:45.052805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:45.053638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:45.054264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:45.054337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 262/534] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:45.060520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:45.184423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6427b-e5f9-4359-8966-37a1193a4c9e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:45.186320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:45.222221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:45.222836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.223119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.223391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.224076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:45.226310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:45.246162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 273/535] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:59:45 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:45.256741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fd113-247e-4fcc-bc20-5d6d9bdec00d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:45.312779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:45.313406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.313659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.313992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.314664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:45.315017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:45.316599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:45.326793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 263/536] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:45.334241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:45.456675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5dde8-56f6-4bbb-a70e-aad88c18fa40 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:45.496321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:45.497022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.497356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.497632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.509423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:45.510878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b81492fe-7384-4c91-8f25-c99b430b6841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:45.526648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:45.527608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:45.528521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:45.528521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:45.528521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:45.528521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 274/537] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:45.534700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:45.588293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:45.605254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733ebe4-2411-4b76-b452-001ca9c2b7cc None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.605905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733ebe4-2411-4b76-b452-001ca9c2b7cc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.606383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733ebe4-2411-4b76-b452-001ca9c2b7cc None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.608224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 275/538] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:45.613066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e52d2-f010-4280-a264-90e3aa5f5b06 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.613600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e52d2-f010-4280-a264-90e3aa5f5b06 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.614070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e52d2-f010-4280-a264-90e3aa5f5b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.628204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:45.634737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-295e52d2-f010-4280-a264-90e3aa5f5b06 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:45.636024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-295e52d2-f010-4280-a264-90e3aa5f5b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:45.649507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3cabf-eae3-46fa-9b59-823b788918ab None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:45.691415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:45.692074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.692358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.692634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.693836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:45.694327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:45.696582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:45.711801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 264/539] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:45.717282 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:45.720081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 276/540] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:45.823511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd812-8d5e-41c2-948c-4b8e00697ccc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:45.824533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9953a-67ba-45d6-ba59-d5d96e54dcde None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.825102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:45.826002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9953a-67ba-45d6-ba59-d5d96e54dcde None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.826431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9953a-67ba-45d6-ba59-d5d96e54dcde None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.828124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 277/541] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:45.833517 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.834755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.835132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.861146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:45.861786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:45.862083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:45.862366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:45.865730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:45.867331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:45.875894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:45.875894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:45.888444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:45.889596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:45.890617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 265/542] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:45.912286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.021878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efd1cb-e5e2-455a-a420-bcebc1d2108c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.060291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.061056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.061442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.061822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.062754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:46.063183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:46.064876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1675f24-0b7a-4c48-87bf-576407f4bc96 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:46.069400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 278/543] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:46.085718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 266/544] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Oct 17 02:59:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:46.091212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.135189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05005ac-5301-4cba-88f2-6c07cd2234b8 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.135534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05005ac-5301-4cba-88f2-6c07cd2234b8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.135850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05005ac-5301-4cba-88f2-6c07cd2234b8 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.137582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 267/545] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:46.142780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.143064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.143458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.174108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:46.175948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:46.188285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:46.193580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:46.229056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0407d-f370-402b-9a95-8e990723abe2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.252181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 268/546] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 17 02:59:46.253109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.266817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.267751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.268196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.268638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.280728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:46.282556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:46.306212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:46.307248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:46.308165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:46.308165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:46.308165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:46.314059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 279/547] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:46.321128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.418439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083761b-fd57-45c2-b9fe-7de1f2b22242 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.457431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03922626-7998-48c1-a996-29155d892dd7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.462950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.463756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.464217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.464638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.465847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:46.467724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:46.476322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:46.491466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 269/548] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:59:46 2022] POST /identity/v3/services => generated 240 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:46.492929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.502787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.503483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.503772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.504133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.504883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:46.505244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:46.507509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:46.512292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:46.525347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 280/549] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:46.534527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.652690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce350f7-ba3a-4bd0-837b-59ec25fca6d1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.692172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bde92-add8-4cad-9003-da42fee5a76c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.699803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.700492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.700779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.701494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.714520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:46.720615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:46.721549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:46.722407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 270/550] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:46.723121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.738550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.739194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.739477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.739754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.750700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:46.752706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:46.766676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:46.767622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:46.768558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 281/551] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:46.769063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.811013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:46.813627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:46.855317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0fe60-b396-4998-9815-031fc306feca None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.890776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5acfa-dfae-4074-8cd2-30ac2d9c25e8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:46.895343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.896062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.896867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.897142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.909957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:46.915655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:46.916634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:46.917466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 271/552] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:46.922879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:46.934470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:46.935087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:46.935395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:46.936201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:46.936881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:46.937190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:46.939320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:46.959665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 282/553] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:46.960998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.049152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963123d-8455-490d-9074-cbe27ba4cf7f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.080119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:47.089456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:47.090387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e689499-36e1-4081-ad6b-f7bd6f8e9923 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.094160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.095212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.095857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.096543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.097246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:47.097552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.099004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.115905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 272/554] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:47.118620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.139140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.140560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.141142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.141637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.142495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:47.143050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.144915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.158747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 283/555] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:47.159906 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.245781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe08d5e-2b31-42e1-8a8e-ac6c55f11430 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.270204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4550f7-fc2e-435f-807c-6d35a4560049 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.289566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.290495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.290786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.291061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.304351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.306214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.309254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.310210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.310761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.311251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/eb1d31c2fdfe467ebbed5a3a46ab4325/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.313524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=eb1d31c2fdfe467ebbed5a3a46ab4325, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.315249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:47.323517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:47.324611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:47.325502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:47.325502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:47.325502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:47.329476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 273/556] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:47.330450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.335369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 284/557] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:47 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/eb1d31c2fdfe467ebbed5a3a46ab4325/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:47.336617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.371338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:47.438555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:47.560508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bc134-ef44-4bd9-8fc6-58500ae98fcf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.563743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5900601-1795-4c82-833e-db3acc920a5e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.605625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.606310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.606597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.606876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.610382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.611226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.611731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.612251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.613091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:47.613595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.616501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.620545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.621999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.635106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 285/558] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:47.643362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:47.644547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:47.645564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:47.645564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:47.645564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:47.647309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.653148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 274/559] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:47.654572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.825099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:47.849035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:47.851437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86112326-9a9e-438d-9dc1-8d2647c86a6c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.858263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33ab03-87c8-4a47-b358-af863956bdc3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:47.888017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.888646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.888924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.889198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.897368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.898810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.904909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:47.905678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.906094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.906378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.907028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:47.907335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:47.908741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0ef6a-9090-4c2e-aa2c-6fb96f061ddf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7d9b881d-65b9-4e1a-aea3-764246d740fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:47.911216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:47.912705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:47.913637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 286/560] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Oct 17 02:59:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:47.914222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35b064-4285-43f3-9f93-cc0b15cbac92 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.914981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35b064-4285-43f3-9f93-cc0b15cbac92 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.915321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35b064-4285-43f3-9f93-cc0b15cbac92 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.920860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 287/561] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:47.921687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35b064-4285-43f3-9f93-cc0b15cbac92 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:47.932004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 275/562] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:47.933485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:47.933839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:47.934183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:47.965370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:47.967564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:48.042747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35b064-4285-43f3-9f93-cc0b15cbac92 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.058180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 276/563] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:48.059212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.083018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.083682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.084061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.084614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.085345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:48.085655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.087362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.097350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.112190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 288/564] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Oct 17 02:59:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:48.114746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.225805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91da82-f4fc-47ce-b7ee-1054b28a9f56 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.253532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.264533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.265155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.265440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.265715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.286194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f051d04-a113-4f8d-81f7-f1fda2fecca0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.336267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.340721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.342208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.355413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.356081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.356361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.356631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.372129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.374583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:48.400778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:48.402025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 02:59:48.403049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:48.405368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 277/565] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:48.420325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.482845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 289/566] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 02:59:48.483848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.557359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf595424-847c-423e-9f0a-e0a556e8fa60 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.590287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74199-8c44-4f47-85ed-e4864b0e7a3e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.591961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.592999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.593761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.594112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.594488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.595300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:48.595680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.597199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.617785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 278/567] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:48.618717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.622442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.635559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.636508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.636963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.637388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.638175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.639794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:48.649644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:48.650855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:48.651952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:48.654369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 290/568] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:48.655398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.733796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c572cd-f573-4ef0-9b97-898792af8b4a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.769517 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331a02-1458-4cf4-97aa-599362951956 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.770824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.771770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.772086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.772360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.783337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.784913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:48.801503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:48.802807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:48.803889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:48.803889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:48.803889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:48.803889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 279/569] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:48.803889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.815844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.816514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.816814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.817077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.829021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.830845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:48.847081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:48.848169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:48.849048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:48.849048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:48.849048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:48.849048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 291/570] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:48.849813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.864131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.868936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:48.913142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cd3e7-9029-41db-a175-7ab0632f19af None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.954387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.955000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.955284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.955559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.959149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:48.959149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:48.959345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b896aa9-0b0d-4b1d-9b50-fdf44e63a3c8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:48.959850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3f19-6e71-4673-984a-2408cf1ba5e9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:48.968863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 280/571] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:48.968863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e71a-43e8-4330-9e80-3b389959d4b1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.968863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e71a-43e8-4330-9e80-3b389959d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:48.968863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e71a-43e8-4330-9e80-3b389959d4b1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:48.968863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 281/572] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:48.968863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e71a-43e8-4330-9e80-3b389959d4b1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:48.998927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:48.999526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:48.999938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.000133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.000726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.001276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.002375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.014766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 292/573] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.020343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.082515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e71a-43e8-4330-9e80-3b389959d4b1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.092166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.101094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.119818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.120719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.120995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.121316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.121953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.122307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.123678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea6fd8-6e24-4aab-9218-b0dbd75a170a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.126230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1176-13cf-4be4-b3a8-edb0acacd1cf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.135454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 282/574] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.136482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.136763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.137034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.154759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:49.155969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:49.165646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.166331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.166710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.167091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.167815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.168240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.169698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.174579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 293/575] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.175354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.230858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 283/576] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:49.231894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.294711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04073d-2390-4c9c-b25e-9982422e277c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.343291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c4cc8-b36a-4fa6-96e4-f77c3952cb11 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.346846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.347680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.348180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.348602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.352072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.353983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.360355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.362260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:49.378744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:49.379664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:49.381479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:49.381988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 294/577] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:49.387092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.387212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.387212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.387212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.387212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.395837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.397353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:49.408785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:49.409718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 284/578] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:49.410703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.511094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95097c17-0355-479c-af07-be0f87027f54 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.544777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a5b05-1d7b-4caf-ae2c-83c61d8504e5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.550324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.550934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.551213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.551481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.552773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] RBAC: Adding query filter params (interface=public, service_id=21c353738cbb479088aade229722604f, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.553323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.555142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.570214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 295/579] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/endpoints?service_id=21c353738cbb479088aade229722604f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.570214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.581804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.582494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.582712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.582988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.583766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.584110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.585585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.604473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 285/580] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.604473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.631639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.641575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.684503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc19fda-42d8-42d0-a3ff-b75cdba7ebfb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.714194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5648717-e0fc-4f6f-82f6-0c900049cd6d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.722921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.723528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.723812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.724118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.725328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.725633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.727078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.739368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 296/581] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.740740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.754672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.755413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.755704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.756008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] PATH_INFO: `/v3/services/network` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.756578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.757932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:49.766512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:49.767857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:49.769099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 286/582] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:49.772857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.841353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141dc69-dfe5-491b-b5d4-1ddbe38fa748 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.860960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.861521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:49.871308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f619c9-eaef-4950-8ff5-42224b2087af None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:49.876104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4cbbb-cc48-4666-9061-b9f4bfc2730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.876702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4cbbb-cc48-4666-9061-b9f4bfc2730e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.876981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4cbbb-cc48-4666-9061-b9f4bfc2730e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.877251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4cbbb-cc48-4666-9061-b9f4bfc2730e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.877838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4cbbb-cc48-4666-9061-b9f4bfc2730e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.880240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4cbbb-cc48-4666-9061-b9f4bfc2730e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.884644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 297/583] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/services => generated 772 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.885794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7dc-7c8a-49ce-82bb-4ed91d064fb0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.886077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7dc-7c8a-49ce-82bb-4ed91d064fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.886357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3a7dc-7c8a-49ce-82bb-4ed91d064fb0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.887701 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 298/584] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:49.888265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3a7dc-7c8a-49ce-82bb-4ed91d064fb0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:49.912622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:49.913250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:49.913529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:49.913806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:49.914546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=b7b1497b5e4e4f77a92eba0c3d3b1cac) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:49.914853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:49.916369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:49.922966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 287/585] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/role_assignments?user.id=b7b1497b5e4e4f77a92eba0c3d3b1cac&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:49.923827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:50.026155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3a7dc-7c8a-49ce-82bb-4ed91d064fb0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.071730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9bf81-0af7-48bd-9e8f-411093018780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.072780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9bf81-0af7-48bd-9e8f-411093018780 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.073293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9bf81-0af7-48bd-9e8f-411093018780 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.073670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9bf81-0af7-48bd-9e8f-411093018780 None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/6160cbf6da6840babe24c6252b069d73/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.084423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d01da-d1bd-4eff-98b5-5214749799a1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.095311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9bf81-0af7-48bd-9e8f-411093018780 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=6160cbf6da6840babe24c6252b069d73, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:50.096824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9bf81-0af7-48bd-9e8f-411093018780 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:50.112420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 299/586] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 02:59:49 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/6160cbf6da6840babe24c6252b069d73/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 02:59:50.113547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.113828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.114097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.135354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.136348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.136831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.137292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.138239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] RBAC: Adding query filter params (name=network) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:50.138753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:50.139046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:50.140493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:50.140855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:50.148203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 288/587] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 02:59:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:50.153697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:50.181997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:50.197504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:50.235617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 300/588] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:50.320516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865dff63-9adb-496c-9a42-b19e60150138 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.357619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.358230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.358560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.358838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.359465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:50.359765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:50.361164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:50.367953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 289/589] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 02:59:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:50.374054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:50.509781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbb124-8223-44ed-b1d9-cef8b7c6deb1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.558318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.559342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.559831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.560352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.561336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] RBAC: Adding query filter params (interface=public, service_id=ab553dfaea4a432ca459364dbb5b8d69, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:50.561878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:50.562637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:50.563264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:50.572611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 301/590] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 02:59:50 2022] GET /identity/v3/endpoints?service_id=ab553dfaea4a432ca459364dbb5b8d69&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:50.579011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:50.610291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:50.680230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:50.713672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfd459-fefe-43ed-a429-59d589ad0fc1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.739392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb78f9-e3c2-48fe-b74d-eb96a0d1a429 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.774120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.774759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.775042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.775318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.793360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:50.798720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:50.799665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 02:59:50.800568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:50.801228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 290/591] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:50.805378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.805999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.806281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.806555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.807162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:50.808678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:50.810534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:50.819224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 302/592] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 02:59:50 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:50.925198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f64ec-753c-4f18-8ff5-9b8a7d3dce3e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:50.966304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:50.966930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:50.967214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:50.967490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:50.968207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:50.968513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:50.969944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:50.980019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 291/593] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 02:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:50.989180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:51.123443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:51.133222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e51aa-06a7-4d23-90b7-29453d4571eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:51.172437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:51.173089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:51.173371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:51.173644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:51.187359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:51.188812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:51.204479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:51.205519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:51.206418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:51.206418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:51.206418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:51.206418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 303/594] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:51.212765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:51.223222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:51.339269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03753c-a551-4d82-8d93-b5fb69d243b9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:51.389424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:51.390031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:51.390317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:51.390590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:51.391232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:51.391534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:51.392928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:51.405884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 292/595] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:51.417138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:51.544123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c7cc6-8465-4f6b-9e78-fbdb7a5331eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:51.592573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:51.593216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:51.593505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:51.593781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:51.601826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:51.603260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:51.620125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:51.621110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 17 02:59:51.622091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:51.624121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 304/596] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 02:59:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:51.630918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:51.745898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:51.795709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b1d9-c61c-4386-9f4f-65660014be71 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:51.841146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:51.841762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:51.842044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:51.842320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:51.843048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:51.843354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:51.844852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:51.877948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 293/597] 10.222.0.20 () {56 vars in 1135 bytes} [Mon Oct 17 02:59:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:51.883598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:51.887619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:52.015804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fcc13-0948-4840-a122-a08405ad4fa1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:52.061257 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b4219-b45e-449f-a599-5b8d05935fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:52.061794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b4219-b45e-449f-a599-5b8d05935fab None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.062078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b4219-b45e-449f-a599-5b8d05935fab None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.062349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b4219-b45e-449f-a599-5b8d05935fab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.162533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b4219-b45e-449f-a599-5b8d05935fab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:52.163981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b4219-b45e-449f-a599-5b8d05935fab None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:52.166670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:52.299340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 305/598] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 02:59:52.305608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:52.452926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ab524-82ac-46e3-b410-7f8bec42443d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:52.481051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaff189-62aa-47ec-b07b-eb5b9a165140 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.481390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaff189-62aa-47ec-b07b-eb5b9a165140 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.481611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaff189-62aa-47ec-b07b-eb5b9a165140 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.483196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 306/599] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:52.488234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c815-4cc6-48b5-8d46-b364db4b0f6d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.488523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c815-4cc6-48b5-8d46-b364db4b0f6d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.488806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310c815-4cc6-48b5-8d46-b364db4b0f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.492231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:52.510108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:52.510749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.511028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.511302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.517311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b310c815-4cc6-48b5-8d46-b364db4b0f6d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:52.518522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b310c815-4cc6-48b5-8d46-b364db4b0f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:52.533460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:52.534937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:52.554541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:52.555517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:52.556435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:52.556435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:52.556435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:52.556435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 294/600] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:52.562544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:52.658354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 307/601] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:52.722441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743780-864d-47b4-9e75-850bc6016607 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:52.724906 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd095c65-951d-49d1-ad41-89bd8ebdba4c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.725268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd095c65-951d-49d1-ad41-89bd8ebdba4c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.725601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd095c65-951d-49d1-ad41-89bd8ebdba4c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.727323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 308/602] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:52.732443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.732864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.733237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.752524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:52.753788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:52.771753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:52.772383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:52.772658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:52.772925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:52.773564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:52.773864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:52.775242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:52.797899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 295/603] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:52.803169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:52.803902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:52.862794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:52.877746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 309/604] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 02:59:52.964620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c7bdd-9089-4b75-b6da-6e632e8a5033 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.017770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.018410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.018690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.018962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.030580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.032062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.039338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:53.047127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:53.049677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:53.050762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 296/605] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:53.054476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.150301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d6477-ef22-48d6-935b-1cc9e218537f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.188535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.189589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.190105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.190444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.191127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.192658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:53.202920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:53.204029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 17 02:59:53.205032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:53.205775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:53.205847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 310/606] 10.222.0.20 () {56 vars in 1129 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:53.205847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.208318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99477016-8b53-4317-a1c8-0b6a7d515b26 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.240573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:53.254605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.256169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.257069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.257531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.258875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:53.259625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.262077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.278845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 297/607] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:53.280025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.316163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a34123-5f83-4f27-b03d-0995c9562b6f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.353620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.354246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.354525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.354799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.355372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.356763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:53.366816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:53.367765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:53.368700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 311/608] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:53.369498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.395795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182d9b4-67f9-457b-91eb-fc3588dfd35b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.429840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.430447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.430730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.431003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.431624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:53.431987 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.433355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7398-86c7-49f9-904d-971ea64faff7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.437884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 298/609] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:53.439020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103ddeb-97a4-4e56-b08c-3e981f78e745 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.439301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103ddeb-97a4-4e56-b08c-3e981f78e745 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.439594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103ddeb-97a4-4e56-b08c-3e981f78e745 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.443914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 299/610] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:53.443914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103ddeb-97a4-4e56-b08c-3e981f78e745 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.466435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:53.477245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:53.487231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85066f-28e1-4103-bce3-824b5fd79192 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.524464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.525098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.525378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.525650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.526398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=eb1d31c2fdfe467ebbed5a3a46ab4325) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:53.526705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.528160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.534039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 312/611] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/role_assignments?user.id=eb1d31c2fdfe467ebbed5a3a46ab4325&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:53.534757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.568817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103ddeb-97a4-4e56-b08c-3e981f78e745 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.607340 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.608272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.608552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.608828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.609490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:53.609790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.611232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f190ef5-bdda-416d-81dd-9be6df31cb9f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.616978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 300/612] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:53.618216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44287-902d-428b-9375-2dd7dd0ee577 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.618498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44287-902d-428b-9375-2dd7dd0ee577 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.618768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca44287-902d-428b-9375-2dd7dd0ee577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.638280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-aca44287-902d-428b-9375-2dd7dd0ee577 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:53.639921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-aca44287-902d-428b-9375-2dd7dd0ee577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:53.672454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa9dd5-cd09-4bc1-b531-b33a3e507454 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.711062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.711674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.720030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.720187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 301/613] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:53.720267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.720267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:53.720267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.720487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395489a6-51fd-44f9-9b48-6d6072c2db3b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.720487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395489a6-51fd-44f9-9b48-6d6072c2db3b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.720487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395489a6-51fd-44f9-9b48-6d6072c2db3b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.720675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46055aa0-4754-41cf-aece-8aae2d61b2c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.720751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 302/614] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:53.720751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395489a6-51fd-44f9-9b48-6d6072c2db3b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.727046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 313/615] 10.222.0.20 () {56 vars in 1124 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:53.728433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.728728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.729007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.741494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:53.751122 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:53.753606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:53.768055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:53.847973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 314/616] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:53.847973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:53.868763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395489a6-51fd-44f9-9b48-6d6072c2db3b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:53.931414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:53.932094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:53.932370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:53.932640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:53.934449 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:53.934754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:53.936137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:53.948563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 303/617] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:53.992083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.045934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a7a1d-a7f5-4e61-9dec-1cf61722febd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.124674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.125219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.125498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.125775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.126447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.127818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.150264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:54.164661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 315/618] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 02:59:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:54.165775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.176390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:54.189790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8a92-8969-469b-9034-f0c4677d4253 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.266860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.267512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.267794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.268090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.287209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:54.293830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:54.294828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:54.296149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 304/619] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 02:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:54.301495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.347907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e070c9-b463-4a17-888a-52ca55ef4ae8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.386245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.386804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.387101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.387351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] PATH_INFO: `/v3/services/network` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.387956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.389331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:54.399086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:54.400193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 17 02:59:54.401138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:54.402523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 316/620] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:54.408474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.441115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70c03b-cbb9-4ae9-a2d1-e7e3e0f5fc37 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.477190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.478223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.478742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.479230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.480147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:54.480656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.482241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.483192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:54.490384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:54.493077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 305/621] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:54.499653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.529705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b5b53-6d41-4d67-9313-8661804c2e57 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.574048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.575063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.575556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.576302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.577203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:54.578326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.580336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.587842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 317/622] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:54.596039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.626526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43293d61-fe56-4f59-b6a0-58e61da0aad0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.671334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.672469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.672961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.673459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.686141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.687850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:54.704988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:54.706005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:54.706894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:54.706894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:54.706894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:54.709118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 306/623] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:54.718119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.746946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d041c-6e75-4763-80a4-052e3d2e1a79 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.806924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:54.809160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.810299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.810299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.810299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.810914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] RBAC: Adding query filter params (type=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:54.811221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.812731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.816170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:54.828973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 318/624] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:54.831201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:54.882490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9f8a-ccea-45d7-ba6f-b7d9bfbbccce None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:54.918803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:54.919572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:54.919991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:54.920647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:54.921446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:54.921796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:54.923267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:54.937095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 307/625] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:54.946156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:55.036187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6b67b-6d03-4201-9c80-861987994129 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:55.076242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:55.076863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:55.077128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:55.077402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:55.078072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:55.079429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:55.108600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 319/626] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 02:59:54 2022] POST /identity/v3/endpoints => generated 337 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:55.134476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3734-2173-4f3a-ac29-2a364eb71ca7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:55.147163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:55.187077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:55.187638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:55.187941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:55.188263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:55.202341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:55.203839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 02:59:55.221305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:55.222344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:55.223284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 308/627] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 02:59:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 02:59:55.228405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:55.305534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:55.369398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade867b-0d75-47e2-aede-7ca405aa9377 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:55.407512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:55.408150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:55.408426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:55.408694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:55.409468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:55.409770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:55.411195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:55.429539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 320/628] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Oct 17 02:59:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:55.435139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:55.543649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df66595-aaf9-4b32-b4c9-114e237222bb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:55.579736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:55.580733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:55.581213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:55.581701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:55.614386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:55.663838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:55.665715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:55.784050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 309/629] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 02:59:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 02:59:55.787504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:55.894831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db15071-5a8e-4bde-bd5f-a24849ea869d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:55.933629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:55.934270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:55.934548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:55.934819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:55.949227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:55.949434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:55.959505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f60cecf2-8fd0-4766-b14b-ab8ae58ecd00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 02:59:55.966377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:55.967384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 02:59:55.968310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 02:59:55.968310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 02:59:55.968310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:55.968310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 321/630] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:55.973814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.044963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:56.050881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9e25d-012b-42ef-9185-f2c24033de59 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.051169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9e25d-012b-42ef-9185-f2c24033de59 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.051449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9e25d-012b-42ef-9185-f2c24033de59 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.053757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 322/631] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 02:59:56.058938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.059168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.059435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.079001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:56.080229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:56.081525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2706e7-5daa-49b8-8de1-1920e140d70b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.116510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.117482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.117968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.118433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.119276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:56.119769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.121364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.133962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 310/632] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 02:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:56.141908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.157631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 323/633] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 02:59:56.241741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991a42-80e6-4750-b1fb-2cbad83c7756 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.266595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:56.277780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.278410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.278690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.278967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.285929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.287928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 02:59:56.299234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:56.300140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 02:59:56.301037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:56.305128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 311/634] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 02:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:56.309009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.416274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7001a10-0a7c-42b3-9a72-142e8857c226 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.417934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:56.429184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.453996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.454609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.454878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.455149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.455826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:56.456155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.457580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.469638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 324/635] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 02:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:56.476701 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.543711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd8e11-e88c-40e9-91f7-cbbfad1f60c8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.580645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.581269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.581550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.581818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.582387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.584305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-982ecce4-e3b3-45fc-8d99-2964f626d55e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:56.593418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:56.594422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 02:59:56.595268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 312/636] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 02:59:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:56.596752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b688c9-f5f5-47c1-94aa-3f5fe3af1dea None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.596752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b688c9-f5f5-47c1-94aa-3f5fe3af1dea None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.596752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b688c9-f5f5-47c1-94aa-3f5fe3af1dea None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.597509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 313/637] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:56.601261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b688c9-f5f5-47c1-94aa-3f5fe3af1dea None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.603804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366070ce-c100-446a-ac40-3144a4b07af4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.639777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.640650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.641045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.641313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.642031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=6160cbf6da6840babe24c6252b069d73) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:56.642333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.643776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b083908-d66d-491c-80ba-8310b6143add None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.650227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 325/638] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 02:59:56 2022] GET /identity/v3/role_assignments?user.id=6160cbf6da6840babe24c6252b069d73&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 02:59:56.651386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.651668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.651967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.670389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:56.671919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:56.673547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:56.690544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:56.737356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b688c9-f5f5-47c1-94aa-3f5fe3af1dea None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.779924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.779924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.779924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.779924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.780407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:56.780407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.780943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 326/639] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:56.781519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193d8a5-2adc-4a9d-acbc-d7311263dcb3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.795543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 314/640] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 02:59:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:56.801112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:56.840889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a5ef-1a94-4b6f-85ee-95c81175ffdc None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.841166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a5ef-1a94-4b6f-85ee-95c81175ffdc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.841439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a5ef-1a94-4b6f-85ee-95c81175ffdc None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.842992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 315/641] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:56.848276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f835-a145-4383-baad-152337089f45 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.848559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f835-a145-4383-baad-152337089f45 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.848879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f835-a145-4383-baad-152337089f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.868300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8917f835-a145-4383-baad-152337089f45 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:56.869500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8917f835-a145-4383-baad-152337089f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:56.916417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a7878-fb7c-4c71-8fe3-9e5c72bf514f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:56.955912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 316/642] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 02:59:56.969764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:56.970382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:56.970660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:56.970930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:56.971728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:56.972113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:56.973481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:56.979162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 327/643] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 02:59:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:57.059988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f835-a145-4383-baad-152337089f45 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:57.109400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:57.170899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f835-a145-4383-baad-152337089f45 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:57.205596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:57.206259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:57.206489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:57.206757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:57.207485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:57.208943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:57.226188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 317/644] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:59:57 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 02:59:57.234884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:57.253685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:57.355833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c8f15-92e3-426b-87be-e517a5ff5110 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:57.406118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:57.406754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:57.407029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:57.407294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:57.407864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:57.409246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:57.418492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:57.419657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 02:59:57.420731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:57.423194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 328/645] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:59:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:57.429792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:57.539522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a141-e475-4310-b2a5-12c4d62146ca None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:57.541474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:57.579727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:57.580606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:57.581066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:57.581490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:57.582323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:57.582789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:57.584896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043dee82-7ae3-48c0-ad0f-1b517f10a8d4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:57.590203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 318/646] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:59:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:57.598881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:57.671166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:57.702448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695189a-b4e4-443d-b5b6-9a49ffb161ad None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:57.736910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:57.737515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:57.737793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:57.738063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:57.738684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:57.738984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:57.740416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e5aa4-5228-4dc3-a139-0962bf9cf601 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:57.745727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 02:59:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:59.151288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2e800-8f15-4bc4-9599-4e5960989ce6 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.151815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2e800-8f15-4bc4-9599-4e5960989ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.151815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2e800-8f15-4bc4-9599-4e5960989ce6 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.153686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 319/648] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:59.158937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.159336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.159682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.179180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:59.180400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:59.238090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f54c2-27fe-432e-9007-738e0aab3c0c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.238090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f54c2-27fe-432e-9007-738e0aab3c0c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.238090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f54c2-27fe-432e-9007-738e0aab3c0c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.238762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 320/649] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:59.244709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3f68-bda9-4de0-afed-7bef6e8840e4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.245272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3f68-bda9-4de0-afed-7bef6e8840e4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.245749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a3f68-bda9-4de0-afed-7bef6e8840e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.249616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 330/650] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 02:59:59.265321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-880a3f68-bda9-4de0-afed-7bef6e8840e4 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:59.266938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-880a3f68-bda9-4de0-afed-7bef6e8840e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:59.338049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 321/651] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 02:59:59.519594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:59.538398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f015-fbe8-4c81-87e0-5068bc51d7d8 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.539009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f015-fbe8-4c81-87e0-5068bc51d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.539515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089f015-fbe8-4c81-87e0-5068bc51d7d8 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.541312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 322/652] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 02:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 02:59:59.546541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.547028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.547513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.566423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 02:59:59.568791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 02:59:59.589935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:59.627224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5acf827-f500-4902-a904-1734f51a59e6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:59.653076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 323/653] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 02:59:59 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 02:59:59.656789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:59.670294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:59.670938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.671221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.671494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.682496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 02:59:59.686712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 02:59:59.688688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 02:59:59.689764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 02:59:59.691157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 02:59:59.695789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 331/654] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 02:59:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 02:59:59.696677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:59.777459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc3dd-c4d8-4f16-8842-dc7a8cd6eb2f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:59.799992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925bda5-0b82-4b16-8b12-26c8107615ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 02:59:59.817416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:59.818969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.819457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.819979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.820949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:59.822562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:59.826999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:59.837252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 02:59:59.837911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 02:59:59.838195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 02:59:59.838468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 02:59:59.839201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 02:59:59.839485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 02:59:59.840951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 02:59:59.848342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 324/655] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 02:59:59 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 02:59:59.855170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 332/656] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Oct 17 02:59:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 02:59:59.856444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:59.938293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 02:59:59.961685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 02:59:59.992273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fbc80-36ef-48c3-b8ae-2b9473318595 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.038567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.039437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.039902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.040169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.053847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.055062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b12c068f-ecaa-4ff2-9b01-56a02fbfe082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:00.076404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:00.077463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:00.078352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:00.078352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:00.078352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:00.078352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 325/657] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 02:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:00.079739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680ba1-a48a-438b-b6df-5d103f203a05 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.079739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680ba1-a48a-438b-b6df-5d103f203a05 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.079739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680ba1-a48a-438b-b6df-5d103f203a05 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.080605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 326/658] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:00.084546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0680ba1-a48a-438b-b6df-5d103f203a05 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.095250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01dd7e-6953-4770-918f-18f2883b7242 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.132415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.133056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.133340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.133615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.134220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.135586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-37cc738a-9c30-4e35-a93c-be807d048f86 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:00.144374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:00.145521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 03:00:00.146750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:00.149130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 333/659] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Oct 17 02:59:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:00.150440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54294-8436-4481-846a-305d06bfca73 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.150875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54294-8436-4481-846a-305d06bfca73 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.151327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54294-8436-4481-846a-305d06bfca73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.169410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-26e54294-8436-4481-846a-305d06bfca73 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:00.170651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-26e54294-8436-4481-846a-305d06bfca73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:00.200119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0680ba1-a48a-438b-b6df-5d103f203a05 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.220726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:00.238879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.240041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.240326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.240602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.241497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:00.241884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.243305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 334/660] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:00 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:00.243965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e54294-8436-4481-846a-305d06bfca73 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.252607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.255097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:00.271661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 327/661] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:00.276972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.365579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e54294-8436-4481-846a-305d06bfca73 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.393492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35ef25-333e-4c2d-962c-d674c5d27d9d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.409120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.409733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.410029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.410536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.411167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:00.412032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.413570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.424120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 335/662] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:00.425862 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.436763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.437457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.437741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.438017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.446169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.447669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:00:00.460096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:00.461033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:00.461970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 328/663] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:00.467073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.485935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:00.530715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:00.548757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443bf7c-9ebe-46f4-b423-7c09e6eece5c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.582073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d62164-7e19-4cec-a9b5-6656263497dc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.583005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.584227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.584506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.584777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.585399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:00.585704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.587071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.591865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 336/664] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:00.592645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.629024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.630096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.630550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.630996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.631924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:00.632422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.634079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.654218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 329/665] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:00.655285 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.700484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc39231-75e0-4164-9cc7-1036a1b3f719 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.711566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:00.739089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.740727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.741018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.741546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.742540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.744343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.762218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 337/666] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:00:00 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:00.762218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.767334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f63-b704-4f82-89df-92dbcc57f343 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.785018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:00.820733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.821476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.821826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.822167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.823068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] RBAC: Adding query filter params (interface=public, service_id=af511f301806467fa108c2e19d333a51, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:00.823653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.825513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:00.838661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 330/667] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/endpoints?service_id=af511f301806467fa108c2e19d333a51&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:00.840057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:00.923993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac235f-50af-41f7-969c-fca12eb90501 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.977735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:00.978709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:00.978989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:00.979414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:00.987192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5727812-ed0a-413b-a4b4-994338347207 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:00.993101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:00.994548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:01.011577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:01.012608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:01.013485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:01.013485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:01.013485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:01.013485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 338/668] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:01.021746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:01.039148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:01.039773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:01.040080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:01.040369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:01.040967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:01.042329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:01.050945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 331/669] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:00:00 2022] GET /identity/v3/services => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:00:01.054411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:01.147287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5db6-c1d2-4794-ba4a-6fb816e96f42 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:01.185950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:01.186558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:01.186787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:01.186999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:01.187642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:01.187975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:01.189352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:01.203364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 339/670] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:01.209963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:01.249031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:01.321104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9ce6b-5b68-43a6-95f8-a250679f67f1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:01.358017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:01.358639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:01.358915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:01.359183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:01.365998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:01.367708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:00:01.378766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:01.379750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:01.381652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 332/671] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:01.388292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:01.472617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:01.492774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741042c-e023-4b1b-9d9d-289fa003a802 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:01.527764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:01.528408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:01.528696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:01.528969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:01.529651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:01.529952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:01.531384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9ac45-515e-46e1-9e6b-d9f1b1d32558 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:01.543328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 340/672] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:01.549316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:01.650884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:01.657709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee181c6-2493-476b-8341-4d4913ff1349 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:01.692566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20393dc9-5149-4c34-bb2a-2ef253bfde9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:01.693580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20393dc9-5149-4c34-bb2a-2ef253bfde9a None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:01.694074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20393dc9-5149-4c34-bb2a-2ef253bfde9a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:01.694575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20393dc9-5149-4c34-bb2a-2ef253bfde9a None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/6160cbf6da6840babe24c6252b069d73/roles/2c18e03036df47a18914701e2fc3af99` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:01.696968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20393dc9-5149-4c34-bb2a-2ef253bfde9a None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=6160cbf6da6840babe24c6252b069d73, role_id=2c18e03036df47a18914701e2fc3af99)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:01.698598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20393dc9-5149-4c34-bb2a-2ef253bfde9a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:01.720064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 333/673] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:00:01 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/6160cbf6da6840babe24c6252b069d73/roles/2c18e03036df47a18914701e2fc3af99 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:00:02.105340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ab8f-3962-4279-af09-3838800dfed0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:02.105711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ab8f-3962-4279-af09-3838800dfed0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:02.105903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ab8f-3962-4279-af09-3838800dfed0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:02.107527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 341/674] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:02.112731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:02.113026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:02.113306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:02.132449 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:02.133652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:02.203370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 334/675] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:02.471584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ab8f-3962-4279-af09-3838800dfed0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:02.579135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ab8f-3962-4279-af09-3838800dfed0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:02.615124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:02.615760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:02.616073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:02.616604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:02.617190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:02.618639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:02.630612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:02.631687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:02.633070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 342/676] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:02.638485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:02.724589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:02.740162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c4e2f-1cd7-4ebe-b1e1-2f48e9f20dc3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:02.775552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:02.776199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:02.776480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:02.776754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:02.777382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:02.777685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:02.779049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:02.784098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 335/677] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:02.790397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:02.800138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:02.899885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf199c9-422f-4e54-bd3d-9086edeea09c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:02.940710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:02.941340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:02.941624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:02.941899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:02.942598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:02.942907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:02.944405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81297d7e-f749-4e81-a6e7-3e811dbbe9bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:02.950262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 343/678] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:02.956628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.042877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f6de-1953-4f66-a596-6a51a34a395e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.043239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f6de-1953-4f66-a596-6a51a34a395e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.043433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5f6de-1953-4f66-a596-6a51a34a395e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.045114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 344/679] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:03.051189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a425d-d0f8-4d43-a716-c9ab05c96c8f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.051500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a425d-d0f8-4d43-a716-c9ab05c96c8f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.052348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a425d-d0f8-4d43-a716-c9ab05c96c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.063246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67df373-fdfe-4038-bdc9-de57dcfb39ea None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:03.075069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3b4a425d-d0f8-4d43-a716-c9ab05c96c8f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:03.076322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3b4a425d-d0f8-4d43-a716-c9ab05c96c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:03.108177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:03.109414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.110317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.111049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.111999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] RBAC: Adding query filter params (interface=public, service_id=5c1cc3779342426ba68697456e98acfe, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:03.112378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:03.113840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:03.121606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 336/680] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 03:00:02 2022] GET /identity/v3/endpoints?service_id=5c1cc3779342426ba68697456e98acfe&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:03.130309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.148920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:03.157258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:03.163950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 345/681] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:03.246489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58004-7c32-441f-a72e-32d7d0161589 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:03.282177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c5440-7920-4762-a913-f26976fb5f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:03.282785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5440-7920-4762-a913-f26976fb5f14 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.283121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5440-7920-4762-a913-f26976fb5f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.283400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c5440-7920-4762-a913-f26976fb5f14 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.284039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c5440-7920-4762-a913-f26976fb5f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:03.285424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c5440-7920-4762-a913-f26976fb5f14 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:03.292504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 337/682] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:00:03 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:00:03.421552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75060b3-2280-408a-944a-26d595fc7e9f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.421744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75060b3-2280-408a-944a-26d595fc7e9f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.422018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75060b3-2280-408a-944a-26d595fc7e9f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.423499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 346/683] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:03.429373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.429656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.429935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.431966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75060b3-2280-408a-944a-26d595fc7e9f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.451064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:03.452344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:03.547896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 338/684] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:03.561793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75060b3-2280-408a-944a-26d595fc7e9f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:03.600998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:03.601636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.601916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.602186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.602826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:03.604344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:03.613504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:03.614568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:03.615397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 347/685] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 03:00:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:03.621137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.635711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:03.726045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d3ca-ef1e-4ddb-9904-1736ef816fbe None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:03.761514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:03.762125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.762407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.762680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.763304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:03.763606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:03.765054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:03.770187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 339/686] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 03:00:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:03.776648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.824915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.844489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:03.885851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e52259-95b5-4c63-a2ed-37b91afa682c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:03.925056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:03.925672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.925954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.926225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.927280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:03.927454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:03.927746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:03.929217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:03.934629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 348/687] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 03:00:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:03.940169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:03.947158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ffe09-0eb0-4f2f-8d65-eb2d8b1d0945 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:03.987064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:03.988087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:03.988565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:03.989054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:03.990352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:03.992235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-dc48c879-a641-443b-aedb-4617b4910c52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:04.002104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:04.003058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 17 03:00:04.003982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:04.011497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 340/688] 10.222.0.20 () {56 vars in 1132 bytes} [Mon Oct 17 03:00:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:04.011921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c6621-9ff7-4660-b756-ddc180cc6231 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.012116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c6621-9ff7-4660-b756-ddc180cc6231 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.012396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c6621-9ff7-4660-b756-ddc180cc6231 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.013805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 341/689] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:04.016596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c6621-9ff7-4660-b756-ddc180cc6231 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.052761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e4c1-453b-4ea5-ab93-1c730e7f9595 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.080652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:04.092096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.092709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.092989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.093258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.093947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] RBAC: Adding query filter params (interface=public, service_id=44f545aaf17d453c92aebaec994fb608, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:04.094260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:04.095610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ed0d9-b321-45fd-8e97-e3c4cba682ea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.100749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 349/690] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 03:00:03 2022] GET /identity/v3/endpoints?service_id=44f545aaf17d453c92aebaec994fb608&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:04.101907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.102187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.102457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.120921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:04.122088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:04.134239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c6621-9ff7-4660-b756-ddc180cc6231 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.173523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.174213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.174505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.174775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.175492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:04.175793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:04.177438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.179479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:04.188008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 342/691] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:04.189218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.194076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 350/692] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:04.199182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.297408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612d682-5775-4479-9c01-6d0888829ccb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.319806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcd55e-c042-4cc8-b8c4-c0521ace35ba None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.325114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:04.342105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.342985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.343266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.343530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.344455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:04.345171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:04.347082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.354350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 351/693] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:04.356352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.357043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.357394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.357737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.358407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:04.359688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.359988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.366743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 343/694] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:00:04 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:00:04.475409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.477470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9040d-5734-4aaf-a112-06ab864f8087 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.531125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.532031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.532461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.533126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.534396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:04.535947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.551524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:04.561169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 352/695] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:00:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:04.596767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a9a1-a7c9-453f-b1d2-3619ff658033 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.646022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.647217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.647705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.648241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.662348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:04.667775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:04.668954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 03:00:04.669804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:04.672641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 344/696] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 03:00:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:04.681070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.731479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:04.792412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3c7c4-4f74-4fd6-8ed3-ff55e72b14d1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.826828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.827351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.827629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.827984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:04.828642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:04.829078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:04.830438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:04.838909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 353/697] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Oct 17 03:00:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:04.844660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:04.953466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64e625-5a9f-489c-aba1-5c893c5145f5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:04.980038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:04.995439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:04.996095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:04.996375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:04.996640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.011526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:05.013022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:05.027529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:05.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:05.031936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:05.031936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:05.031936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:05.031936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 345/698] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:05.034504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:05.141545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a5ae6-2483-4a6e-ab03-9b98eb1263fc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:05.144009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:05.178239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:05.178898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:05.179177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:05.179444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.180105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:05.180411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:05.181828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:05.194250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 354/699] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:05.199721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:05.303734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ece37a-41d6-4618-a785-cb2c8ce4d61d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:05.338604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:05.339233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:05.339513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:05.339782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.347487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:05.349022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:00:05.360316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:05.361295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:05.362748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 346/700] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 03:00:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:05.368007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:05.477677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc35251-b623-42ee-9127-ba8f74be9279 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:05.515625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:05.516648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:05.517110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:05.517561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.518454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:05.518967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:05.521175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18fbd1-f01b-4b03-9288-7a3698f45f31 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:05.540765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 355/701] 10.222.0.20 () {56 vars in 1149 bytes} [Mon Oct 17 03:00:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:05.551929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:05.579582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:05.596612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfc86c-2a01-47f8-8273-5decbf66cc64 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:05.596905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfc86c-2a01-47f8-8273-5decbf66cc64 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:05.597185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfc86c-2a01-47f8-8273-5decbf66cc64 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.603351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 356/702] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:05.604486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:05.604773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:05.605049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.623822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:05.625270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:05.644978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:05.657708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdd644-9d9d-46fb-82e2-f00a53e4d4fb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:05.695815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:05.696980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:05.697364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:05.698124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:05.710188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 357/703] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:05.768354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:05.769807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:05.800094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:05.869671 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 347/704] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:00:05 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 03:00:05.875302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:05.980579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eed5cc-8ee3-4e5a-89de-270ac29abe5a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:05.985025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.025905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.026469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.026753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.027030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.039775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.041580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:06.060342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:06.061324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:06.062232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:06.062232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:06.062232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:06.062837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 358/705] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:06.069120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.073893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:06.105148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d9867-4db7-40c8-8f5c-87920a6460d2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.140665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:06.150427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.151539 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.152160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.152618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.153541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.155370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:06.168345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:06.169378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:06.170239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:06.177883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 348/706] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:06.178934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.199313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4d52d-4ab3-407e-8c9a-35e9e49bdc36 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.244942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.245540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.245817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.246089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.246724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:06.247022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.248645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.262025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 359/707] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:06.267249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.297653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d29d5-f901-4d08-a5ba-ae0387be6f56 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.331648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.332329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.332655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.332985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.333620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:06.333917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.335354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.345300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 349/708] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:06.346380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.354376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:06.400200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87602bd1-12f1-4983-9e44-f52b6ec89aa8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.424783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:06.440769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.441741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.442801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.443310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.450644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.452424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:00:06.464304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:06.465235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:06.466115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:06.468498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 360/709] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:06.475516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.476476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e26f7-f894-4958-9ae6-ad0082d95586 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.518042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.518657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.518931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.519222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.519948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:06.520248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.521658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.532308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 350/710] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:06.533392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.605447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b18b0-ebfc-4993-9184-286c16f8aead None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.631043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:06.644531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.645693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.646468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.646960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.647986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:06.648582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.649715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b33c-23c6-4472-97cf-d710d7b4ec56 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.650565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.665151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 361/711] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:06.671067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:06.690154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:06.703091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d54cd-4498-4a86-9b8d-5cec099f6567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.704013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d54cd-4498-4a86-9b8d-5cec099f6567 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.704711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d54cd-4498-4a86-9b8d-5cec099f6567 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.705367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d54cd-4498-4a86-9b8d-5cec099f6567 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.706252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d54cd-4498-4a86-9b8d-5cec099f6567 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.708470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d54cd-4498-4a86-9b8d-5cec099f6567 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.734580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 351/712] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:00:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:06.778602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c244a06-f739-4c7a-a6c0-d16740481660 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.779417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c244a06-f739-4c7a-a6c0-d16740481660 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.779708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c244a06-f739-4c7a-a6c0-d16740481660 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.781932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 352/713] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:06.788274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.788757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.789128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.804982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf7288-b860-438f-81f6-ae0f8b6b7b93 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:06.813222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:06.814819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:06.851851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:06.852924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.853488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.853934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.854934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] RBAC: Adding query filter params (role.id=2c18e03036df47a18914701e2fc3af99, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=6160cbf6da6840babe24c6252b069d73) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:06.855419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:06.857136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46205b2d-66e7-452f-aaed-d00695d329a7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:06.865357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 362/714] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:00:06 2022] GET /identity/v3/role_assignments?user.id=6160cbf6da6840babe24c6252b069d73&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=2c18e03036df47a18914701e2fc3af99 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:06.886615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a25e6-ec61-45c5-887d-d26507d49348 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.886954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a25e6-ec61-45c5-887d-d26507d49348 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.887191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a25e6-ec61-45c5-887d-d26507d49348 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.888672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 363/715] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:06.894810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:06.895127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:06.896003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:06.907214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 353/716] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:06.929833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:06.931147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:06.983583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:07.015201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 364/717] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:07.187605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.283525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.291128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6099-b278-4afa-a4a5-7a6eb7543316 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.302310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:07.329335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.329969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.330248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.330516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.331095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.332506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:07.341639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:07.342630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:07.343477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 354/718] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 03:00:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:07.349008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.414776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0dc56-e5a4-4db1-a7b6-2fd7a2a7ef25 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.460809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024508b-702c-46dd-84a6-b38ece2dc338 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.461272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.462065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.462744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.463180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.464489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.465878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:07.479270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:07.480296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:07.481152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:07.483974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 365/719] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:07.489980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.509814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.510965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.511390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.511803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.512590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:07.513033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.514962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.522415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 355/720] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 03:00:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:07.527911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.536318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:07.578694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:07.603810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f09e8b-2758-4bdb-be6c-a0612aa9a16d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.642784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.644262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.644704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.645897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.646677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:07.647357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.649621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.656760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 366/721] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:07.662615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a368df-82fa-4817-803f-9a391c428149 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.663691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.699982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.700697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.701044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.701566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.702219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:07.702637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.704177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.715059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 356/722] 10.222.0.20 () {56 vars in 1114 bytes} [Mon Oct 17 03:00:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:07.716406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:07.786399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a847c6-4443-4000-b0d3-31c8e70bbf1e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.788450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:07.824629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.826053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.826528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.826989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.827793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:07.828351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.829908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5fa96-e3e5-4494-a51d-e06a7f6adfa8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.832263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0201-445c-4b40-bac3-86d9bf0c0852 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:07.833990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:07.840174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 367/723] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:07.877035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f163d6-ad31-4e74-bef0-ee0b4db803be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:07.877660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f163d6-ad31-4e74-bef0-ee0b4db803be None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:07.877942 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f163d6-ad31-4e74-bef0-ee0b4db803be None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:07.878272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f163d6-ad31-4e74-bef0-ee0b4db803be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:07.878954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f163d6-ad31-4e74-bef0-ee0b4db803be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:07.880944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f163d6-ad31-4e74-bef0-ee0b4db803be None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:07.909233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 357/724] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:00:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:09.060839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aef798-4023-4617-8f57-9ff169ffe98d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.061347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aef798-4023-4617-8f57-9ff169ffe98d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.061456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aef798-4023-4617-8f57-9ff169ffe98d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.062922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 368/725] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:09.068729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.069581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.070065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.089421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:09.090968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:09.104820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1688-bb8c-49a1-9937-344e29fafb51 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.105111 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1688-bb8c-49a1-9937-344e29fafb51 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.105377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad1688-bb8c-49a1-9937-344e29fafb51 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.107171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 369/726] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:09.112156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.112441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.112713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.136803 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:09.140796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:09.181679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 358/727] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:09.229346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 370/728] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:09.447714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:09.506506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:09.543640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:09.562811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632f6786-f0c8-4755-8e9d-95e7a78c25df None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:09.604900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:09.605541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.605822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.606095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.606679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:09.608067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:09.618156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:09.619203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:09.620108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 359/729] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:09.627514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:09.637401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:09.647274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7673f-8b45-4861-8145-9cfa96ec0130 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:09.694408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:09.696049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.696587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.697365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] PATH_INFO: `/v3/services/image` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.698413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:09.700790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:09.713696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:09.714693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:09.715551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:09.721935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 371/730] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Oct 17 03:00:09 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:09.724814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:09.759864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb151aa-ad6f-4d8b-90ed-fb50a7eec888 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:09.806387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:09.806992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.807269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.807538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.808193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:09.808492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:09.810284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:09.820956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 360/731] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:09.822022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:09.840843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:09.845567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2adb1-d638-4dd0-9594-cab521f6dd3c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:09.891504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:09.892138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:09.892418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:09.892694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:09.893743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:09.894047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:09.896653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:09.907918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 372/732] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:09.910309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:09.939759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:09.951643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfc1aa-b01b-408c-baf8-3a12e081e854 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.000855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.001498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.001778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.002049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.003700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:10.004047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.005554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.015998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 361/733] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:10.018801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:10.044971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca6206-5c2b-4d11-8b16-3b25238982c4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.078998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.079659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.079888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.080176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.080809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] RBAC: Adding query filter params (type=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:10.081110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.082487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1924f9-a6c2-4516-83cf-b1b9704f7360 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.087421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 373/734] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:10.088829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980699-457c-4d3e-ab57-bf5b4377a204 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.089115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980699-457c-4d3e-ab57-bf5b4377a204 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.089386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980699-457c-4d3e-ab57-bf5b4377a204 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.090781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 374/735] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:10.097140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc413-e670-4d6e-976e-b33185576de6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.097449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc413-e670-4d6e-976e-b33185576de6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.097685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc413-e670-4d6e-976e-b33185576de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.110820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:10.121821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0cecc413-e670-4d6e-976e-b33185576de6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:10.123044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0cecc413-e670-4d6e-976e-b33185576de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:10.138315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44dc88-94fd-42aa-8a42-f6767364a512 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.179598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.180660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.181150 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.181650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.182611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] RBAC: Adding query filter params (interface=admin, service_id=5c1cc3779342426ba68697456e98acfe, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:10.183131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.184762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb307b16-292c-4a20-908c-82c1e6e15028 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.190885 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 362/736] 10.222.0.20 () {56 vars in 1249 bytes} [Mon Oct 17 03:00:10 2022] GET /identity/v3/endpoints?service_id=5c1cc3779342426ba68697456e98acfe&interface=admin®ion_id=RegionOne => generated 193 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:10.192834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97182d-6521-4fe5-8595-c07964d7ab6a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.193125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97182d-6521-4fe5-8595-c07964d7ab6a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.193399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97182d-6521-4fe5-8595-c07964d7ab6a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.194809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 363/737] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:10.196735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97182d-6521-4fe5-8595-c07964d7ab6a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:10.205107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 375/738] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:10.212058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.212253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.212523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.233263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:10.234592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:10.251710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:10.315641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 376/739] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:10.321803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97182d-6521-4fe5-8595-c07964d7ab6a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.361429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.362316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.362747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.363174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.363990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.365486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.372493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 364/740] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:00:10 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:00:10.472371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:10.581220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201f2fa-b61b-4263-8cf0-c87924571078 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.584549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:10.588405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:10.619711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.621060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.621792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.622266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.623264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.625387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.648907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 377/741] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:00:10 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:10.714792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f941b4-868d-42d7-8872-47b3c067151a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.761550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.762177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.762456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.762718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.763372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.764937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.767614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING keystone.server.flask.common [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 17 03:00:10.789774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.sql.core [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 03:00:10.789774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 03:00:10.789774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [parameters: {'id': '7e95041168224307838619fabee7e093', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 17 03:00:10.789774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81604) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e95041168224307838619fabee7e093.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e95041168224307838619fabee7e093. Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application conn.query(q) Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 03:00:10.797321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result.read() Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 03:00:10.798200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application next(self.gen) Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application yield resource Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application next(self.gen) Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise self.value Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application session.commit() Oct 17 03:00:10.799146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.session.flush() Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application compat.raise_( Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 03:00:10.800085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 03:00:10.801000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application conn.query(q) Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application result.read() Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 03:00:10.801837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [parameters: {'id': '7e95041168224307838619fabee7e093', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:10.802710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:10.805542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e95041168224307838619fabee7e093. Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:10.807594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 365/742] 10.222.0.20 () {60 vars in 1140 bytes} [Mon Oct 17 03:00:10 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:10.815532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:10.830322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:10.935738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf4139-be2e-4e98-b6da-f00531f48657 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:10.975959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:10.976601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:10.976881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:10.977205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:10.984227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:10.985668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-552700ca-b258-424f-884d-305ea5061c7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:00:10.997466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:10.998344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:10.999229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 378/743] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:11.006720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:11.076504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:11.123452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3529cf-63a8-4a68-ae1a-dfa832d6b109 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:11.158393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:11.159008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:11.159291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:11.159560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:11.160256 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:11.160555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:11.162297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c717d-8042-49cb-aa9a-71e58e0175e1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:11.184282 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 366/744] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:12.308110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfb821-7220-4852-94ad-537bbfc662f4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.308627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfb821-7220-4852-94ad-537bbfc662f4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.308627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfb821-7220-4852-94ad-537bbfc662f4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.310254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 379/745] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:12.315564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30afe5-0316-4031-9fa2-ae6b67678ae9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.315994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30afe5-0316-4031-9fa2-ae6b67678ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.316183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30afe5-0316-4031-9fa2-ae6b67678ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.334961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fb30afe5-0316-4031-9fa2-ae6b67678ae9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:12.336478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fb30afe5-0316-4031-9fa2-ae6b67678ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:12.405193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 367/746] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:12.640937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe178-3892-4763-9d7e-204678c73ca4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.641284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe178-3892-4763-9d7e-204678c73ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.641459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fe178-3892-4763-9d7e-204678c73ca4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.643019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 380/747] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:12.648531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c377-8532-4dad-aeda-1677268818bb None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.648824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c377-8532-4dad-aeda-1677268818bb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.649101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c377-8532-4dad-aeda-1677268818bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.667087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8dc4c377-8532-4dad-aeda-1677268818bb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:12.668304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8dc4c377-8532-4dad-aeda-1677268818bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:12.672690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fe178-3892-4763-9d7e-204678c73ca4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:12.712101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:12.737562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 368/748] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:12.752336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:12.789834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fe178-3892-4763-9d7e-204678c73ca4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:12.825743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b2f9f-09c7-4983-bd67-654cb26acdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:12.826745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2f9f-09c7-4983-bd67-654cb26acdb5 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.827224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2f9f-09c7-4983-bd67-654cb26acdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.827693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2f9f-09c7-4983-bd67-654cb26acdb5 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.828662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b2f9f-09c7-4983-bd67-654cb26acdb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:12.830325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b2f9f-09c7-4983-bd67-654cb26acdb5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:12.854006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 381/749] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:00:12 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:12.966349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811090d0-68de-4427-a317-48d867323aea None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.966640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811090d0-68de-4427-a317-48d867323aea None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.966914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811090d0-68de-4427-a317-48d867323aea None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.968295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 369/750] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:12.975190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:12.975471 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:12.975746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:12.995854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:12.997097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:13.024636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811090d0-68de-4427-a317-48d867323aea None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.091664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 382/751] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:13.147968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811090d0-68de-4427-a317-48d867323aea None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.184136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.185009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.185432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.185842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.186561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.188176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:13.198108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:13.199328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 17 03:00:13.200408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:13.202782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 370/752] 10.222.0.20 () {56 vars in 1126 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:13.213032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.283792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:13.338725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8250ba-3e47-4657-94cd-fde2465941c6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.363927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.381862 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.382887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.383316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.383743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.384573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:13.385021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.386571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.392587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 383/753] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:13.407898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.420657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:13.499603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6a988-7c69-4071-9201-d5ba43e9e2b8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.514062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5612-1ebb-466f-bec1-edee97f3f28d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.535160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:13.546196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.547174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.547647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.548099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.548690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.550051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.555598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.556236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.556518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.556795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.557427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:13.557729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.559081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3c464ef7-8150-4c5a-84a5-3cf75c214b2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:13.562733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:13.563712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:13.564584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 371/754] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:13.565868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b3f-ed67-49ce-a834-04fd4245bd89 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.565868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b3f-ed67-49ce-a834-04fd4245bd89 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.566269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d209b3f-ed67-49ce-a834-04fd4245bd89 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.568727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 372/755] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:13.569358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 384/756] 10.222.0.20 () {56 vars in 1122 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:13.572995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b3f-ed67-49ce-a834-04fd4245bd89 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.574267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.687722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd2edd-8c59-4ef5-93e3-282930c6f36f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.697511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d209b3f-ed67-49ce-a834-04fd4245bd89 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.701323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:13.723585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7547c-b15f-4d0b-a0ef-b65d55a344bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.724227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7547c-b15f-4d0b-a0ef-b65d55a344bb None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.724510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7547c-b15f-4d0b-a0ef-b65d55a344bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.724779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7547c-b15f-4d0b-a0ef-b65d55a344bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.725444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7547c-b15f-4d0b-a0ef-b65d55a344bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.726823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7547c-b15f-4d0b-a0ef-b65d55a344bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.737201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.737910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.738207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.738513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.739715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:13.740048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.741682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.745248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 385/757] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:00:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:13.745248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.745248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.755912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 373/758] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:13.756014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.756098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:13.783270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:13.784528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:13.848751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:13.902388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 386/759] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:13 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:13.914200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0476-1b90-4fff-b9f5-2061eab83fcf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:13.956262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:13.957224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:13.957843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:13.958400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:13.959221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:13.959714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:13.961340 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:13.969177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 374/760] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:13.975716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:14.083790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c4389-7e34-44bb-948b-7cb7af1f274f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:14.121764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:14.122717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:14.123235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:14.123726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:14.124641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] RBAC: Adding query filter params (interface=public, service_id=3cd54b0a41a447d4a19b9f3ea2be61d4, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:14.125155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:14.126863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:14.133421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 387/761] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 03:00:13 2022] GET /identity/v3/endpoints?service_id=3cd54b0a41a447d4a19b9f3ea2be61d4&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:14.139247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:14.172806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:14.187127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:14.222953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:14.259136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d7e00-29db-48bb-9c0b-a49c1c2055d4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:14.296743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:14.297403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:14.297688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:14.297961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:14.298664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:14.300045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:14.313276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 375/762] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:00:14 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:00:14.320970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf769a7-17e1-4050-903b-f0ba6288f107 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:14.360993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:14.362423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:14.362926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:14.363416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:14.364854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:14.366794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:14.369723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING keystone.server.flask.common [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 17 03:00:14.385591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 03:00:14.385591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 17 03:00:14.385591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [parameters: {'user_id': 'b3590708d31245549b17bfabdc7dbc0e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 17 03:00:14.385591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Oct 17 03:00:14.393847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 03:00:14.394805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 03:00:14.396435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 03:00:14.397296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 03:00:14.398185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 03:00:14.399030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b3590708d31245549b17bfabdc7dbc0e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:14.401681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 17 03:00:14.403501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 17 03:00:14.405651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 17 03:00:14.405651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 17 03:00:14.405651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 03:00:14.405651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 03:00:14.405651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 17 03:00:14.405651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:14.408342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 388/763] 10.222.0.20 () {60 vars in 1131 bytes} [Mon Oct 17 03:00:14 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:14.419939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:14.522605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:14.529320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d121206-2af0-4ceb-b7b6-a2218c2c3468 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:14.565355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:14.566021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:14.566312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:14.566586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:14.575202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:14.576680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4e3c8275-3e2c-4515-8c84-32e229a43527 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:00:14.589265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:14.591374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 17 03:00:14.593610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:14.594844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 376/764] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:00:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:14.599918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:14.697698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:14.705560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc683b3b-89e6-4e43-8ba2-72ef70434e12 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:14.742135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:14.743007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:14.743436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:14.743905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:14.744935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:14.745385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:14.747242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18267f-cf2e-496e-9503-efd0b206bdde None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:14.795990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 389/765] 10.222.0.20 () {56 vars in 1101 bytes} [Mon Oct 17 03:00:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:15.107631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08996a18-1cc8-498e-8f66-43b1923fa6af None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:15.108050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08996a18-1cc8-498e-8f66-43b1923fa6af None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:15.108226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08996a18-1cc8-498e-8f66-43b1923fa6af None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:15.109795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 377/766] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:15.115547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:15.115832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:15.116385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:15.135497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:15.137089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:15.203893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 390/767] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:15 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:15.466510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08996a18-1cc8-498e-8f66-43b1923fa6af None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:15.567520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08996a18-1cc8-498e-8f66-43b1923fa6af None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:15.601582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:15.602205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:15.602482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:15.602749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:15.603315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:15.604763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:15.613544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:15.614526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:15.615363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:15.619863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 378/768] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Oct 17 03:00:15 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:15.620881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:15.703044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:15.722607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbc62-2761-47e5-9428-dbe24e7a4614 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:15.758981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:15.759577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:15.759854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:15.760150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:15.760763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:15.761060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:15.762416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:15.767360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 391/769] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:15.772863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:15.794885 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:15.873623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0199-1e0b-4d82-9769-8424fe7ff6c4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:15.907715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:15.908344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:15.908625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:15.908894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:15.909511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] RBAC: Adding query filter params (type=image) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:15.909807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:15.911250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b985b3-0c71-4c19-ae6c-02bd96182062 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:15.916200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 379/770] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:15.922043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:16.030526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd752-f559-4943-91cf-0272f087f8d3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:16.064021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:16.064626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.064901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.065202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.065845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] RBAC: Adding query filter params (interface=public, service_id=70f543e6dd8843a7adab35fa117582e4, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:16.066147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:16.068061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:16.069147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e204d-bbe0-4b8f-9b3e-294113a9ed29 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.069435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e204d-bbe0-4b8f-9b3e-294113a9ed29 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.069707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e204d-bbe0-4b8f-9b3e-294113a9ed29 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.071303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 380/771] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:16.076157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 392/772] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 03:00:15 2022] GET /identity/v3/endpoints?service_id=70f543e6dd8843a7adab35fa117582e4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:16.076360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.076612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.076892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.078780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:16.092319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:16.098912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:16.100128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:16.169182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 381/773] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:16.188283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4371d65-713a-49ad-a327-55b07385dedc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:16.221670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f068e9-b4fa-4688-b688-c660a738428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:16.222265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f068e9-b4fa-4688-b688-c660a738428e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.222541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f068e9-b4fa-4688-b688-c660a738428e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.222809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f068e9-b4fa-4688-b688-c660a738428e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.223954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f068e9-b4fa-4688-b688-c660a738428e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:16.225302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f068e9-b4fa-4688-b688-c660a738428e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:16.236260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 393/774] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:00:16 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:00:16.441785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:16.458578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:16.543637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d0500-089b-49c9-bcfd-bf4e7badef63 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:16.556866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8690c-bc52-4433-a671-98832c27ffeb None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.557160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8690c-bc52-4433-a671-98832c27ffeb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.557445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8690c-bc52-4433-a671-98832c27ffeb None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.559914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 394/775] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:16.563809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.564131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.564407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.579250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:16.579894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.580191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.580463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.581554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:16.583054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:16.583820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:16.585121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:16.586489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 382/776] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:16.590248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:16.654616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 395/777] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:16 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:16.677459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:16.696620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e1799-7697-420d-9686-8e42e8bd2c58 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:16.731135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:16.731796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:16.732108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:16.732381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:16.733029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:16.734437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:16.765366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 383/778] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:00:16 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:00:16.924046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:16.927226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:17.032586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650d4b1-90df-495a-a768-b1d6e93b0f1a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:17.066836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:17.067468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:17.067746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:17.068049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:17.068620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:17.069979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:17.078741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:17.080098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:17.081144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 396/779] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:17.088834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:17.191589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81076a-b892-4594-afeb-142e1409dafc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:17.224387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:17.224925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:17.225204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:17.225474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:17.226091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:17.226391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:17.227743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:17.228808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:17.238109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 384/780] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:17.239952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:17.309497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:17.343760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a9900-06fa-4e00-811e-c32a2e39e671 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:17.378065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:17.378720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:17.379006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:17.379306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:17.379978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:17.380283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:17.381655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826943c-65c2-4f92-a1ec-98157be3147f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:17.392609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 397/781] 10.222.0.20 () {56 vars in 1112 bytes} [Mon Oct 17 03:00:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:17.392747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:17.494398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfdc72-10ce-44d0-ab91-bbcdf0db9ddf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:17.527669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9997483-ba4b-4851-a670-dc390eac5890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:17.528297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9997483-ba4b-4851-a670-dc390eac5890 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:17.528579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9997483-ba4b-4851-a670-dc390eac5890 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:17.528853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9997483-ba4b-4851-a670-dc390eac5890 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:17.529515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9997483-ba4b-4851-a670-dc390eac5890 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:17.530861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9997483-ba4b-4851-a670-dc390eac5890 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:17.559906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 385/782] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:00:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:00:18.376222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3889fa-88f6-438c-a213-b34267fef436 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:18.376739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3889fa-88f6-438c-a213-b34267fef436 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:18.376815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3889fa-88f6-438c-a213-b34267fef436 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:18.378242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 398/783] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:18.383765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:18.384089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:18.384363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:18.402676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:18.403861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:18.454205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:18.483916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 386/784] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:18.748578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3889fa-88f6-438c-a213-b34267fef436 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:18.851522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3889fa-88f6-438c-a213-b34267fef436 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:18.886376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:18.892547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:18.893183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:18.893464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:18.893735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] PATH_INFO: `/v3/services/image` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:18.894317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:18.895758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6ebade75-5990-466f-9548-777a62867d88 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:18.904597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:18.905599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:18.906463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 399/785] 10.222.0.20 () {56 vars in 1105 bytes} [Mon Oct 17 03:00:18 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:18.911519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:18.975666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70cd0-048c-4733-b258-ba3e58597a76 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:18.975978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70cd0-048c-4733-b258-ba3e58597a76 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:18.976254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70cd0-048c-4733-b258-ba3e58597a76 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:18.977757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 400/786] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:18.982800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:18.983456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:18.983953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.004982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:19.006168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:19.019642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924418d1-40b8-47cd-ae38-c6a24d66e0a0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:19.055324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:19.055958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.056238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.056505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.057127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:19.057428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:19.058772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:19.063893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 387/787] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:19.069799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:19.076680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 401/788] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:19.119512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:19.173941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500bcaf-cec3-40a6-98d8-eb0d54a9bff4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:19.207805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:19.208429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.208711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.208983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.209607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] RBAC: Adding query filter params (type=image) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:19.209918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:19.211267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:19.216330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 388/789] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:19.221660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:19.326750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfe3e4-20a6-4950-8824-3aab9ba1e12b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:19.348642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:19.352434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:19.362311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:19.362922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.363331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.363654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.364995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:19.366627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:19.395918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 402/790] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:00:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:19.463897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8c127-8d21-4eff-9732-6d5416a42d97 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:19.474467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:19.509886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5c912-b38b-4b68-94fa-0f04b10e7785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:19.510527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c912-b38b-4b68-94fa-0f04b10e7785 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.510834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c912-b38b-4b68-94fa-0f04b10e7785 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.511104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5c912-b38b-4b68-94fa-0f04b10e7785 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.512256 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5c912-b38b-4b68-94fa-0f04b10e7785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:19.513701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5c912-b38b-4b68-94fa-0f04b10e7785 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:19.515497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 389/791] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:19.521630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:19.628766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067589e2-7570-421b-a528-b4e6a188a61f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:19.663121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b2f4d-1878-4417-9475-fa748eec8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:19.663748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b2f4d-1878-4417-9475-fa748eec8995 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.664065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b2f4d-1878-4417-9475-fa748eec8995 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.664344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b2f4d-1878-4417-9475-fa748eec8995 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.665010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b2f4d-1878-4417-9475-fa748eec8995 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:19.666431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356b2f4d-1878-4417-9475-fa748eec8995 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:19.695928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 403/792] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 03:00:19 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:00:19.807556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431cfc7-8790-4c5e-8479-6fcdc2c89d22 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.807856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431cfc7-8790-4c5e-8479-6fcdc2c89d22 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.808156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2431cfc7-8790-4c5e-8479-6fcdc2c89d22 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.809672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 390/793] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:19.815202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:19.815576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:19.815947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:19.836438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:19.837728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:19.868958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:19.909219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 404/794] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:20.174077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431cfc7-8790-4c5e-8479-6fcdc2c89d22 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:20.281031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2431cfc7-8790-4c5e-8479-6fcdc2c89d22 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:20.315648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:20.316344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:20.316654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:20.316923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:20.327633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:20.332946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:20.333849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:20.334692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 391/795] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 03:00:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:20.340415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:20.447119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6401c-799e-4bef-ad92-eb9d778d7119 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:20.480845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:20.481452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:20.481746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:20.481995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:20.482657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:20.482958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:20.484387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:20.493384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 405/796] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Oct 17 03:00:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:20.498838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:20.530962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:20.600309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14209dd8-4cf4-4050-9364-bc171018cc1a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:20.637270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:20.637904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:20.638187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:20.638459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:20.648676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:20.650120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:20.665276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:20.666298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:20.667813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:20.667813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:20.667813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:20.671101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 392/797] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:20.672269 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:20.703854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:20.888508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613b212-e53a-4179-a678-2cd21e696590 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:20.921089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:20.921687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:20.921966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:20.922235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:20.922860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:20.923160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:20.924566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:20.936301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 406/798] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:20.941892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.034136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:21.052072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece14c8-166e-40de-864c-efc243d50142 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:21.086358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:21.087013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.087289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.087557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.095043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:21.096512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:00:21.107499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:21.108494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:21.109465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 393/799] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Oct 17 03:00:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:21.116729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.208930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:21.219526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9706957-ac73-4734-80a1-06e25a2552c2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:21.253342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:21.253972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.254289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.254560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.255280 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:21.255582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:21.257021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:21.274398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 407/800] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Oct 17 03:00:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:21.281645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.381013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeda6-7c38-475b-b8ea-4a5648588230 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:21.413868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:21.414494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.414772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.415042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.425530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:21.427000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:21.429568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-20fd603b-aaa0-47fe-91dc-e7a2d7c6a0e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:21.442588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:21.443530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:21.444456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:21.444456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:21.444456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:21.445098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 394/801] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:21.449765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.554403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b937b0-8415-414c-8c02-0dc791709098 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:21.590348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:21.590953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.591231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.591501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.592161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:21.592464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:21.593819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:21.599154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc97410-6a98-452b-b394-370ab8b28da0 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.599445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc97410-6a98-452b-b394-370ab8b28da0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.599723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc97410-6a98-452b-b394-370ab8b28da0 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.601217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 395/802] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:21.609512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 408/803] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:21.609669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.609669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.609669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.610556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.621548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:21.625802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:21.626999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:21.696924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 396/804] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:21.714455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10821f-2b4d-459d-b7b9-751dceb16de1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:21.748090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:21.748717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.748996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.749268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.755833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:21.757304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-03eb1b54-5524-45f5-a542-90a0225ddda8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:00:21.768309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:21.769235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:21.775961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 409/805] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:21.776488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.879674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddfbd35-4617-4140-9f00-2f7d099a317c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:21.902018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773c93-9890-47b2-8ce1-f121b663f2c0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.902377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773c93-9890-47b2-8ce1-f121b663f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.902568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773c93-9890-47b2-8ce1-f121b663f2c0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.903922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 410/806] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:21.906140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:21.909025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.909306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.909579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.916592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:21.917195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:21.917483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:21.917767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:21.918441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:21.918743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:21.920193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:21.928710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:21.930892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:21.932218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 397/807] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:21.937934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:21.999739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:22.005608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 411/808] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:22.008546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.043382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199de62-a5b1-4227-a47c-935c63fc6cfb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.081701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.082394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.083012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.083303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b7b1497b5e4e4f77a92eba0c3d3b1cac/roles/2c18e03036df47a18914701e2fc3af99` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.086139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=b7b1497b5e4e4f77a92eba0c3d3b1cac, role_id=2c18e03036df47a18914701e2fc3af99)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.088131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.102637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 398/809] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:00:21 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/b7b1497b5e4e4f77a92eba0c3d3b1cac/roles/2c18e03036df47a18914701e2fc3af99 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:00:22.109205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247b5bf-6fcb-4e7d-9aa5-b3b1af347959 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.148913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.149457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.149736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.150010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.150683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.152091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.161102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 03:00:22.161102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 03:00:22.161102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [parameters: {'id': 'b64007a317b64944b67f10326ae77128', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 03:00:22.161102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 03:00:22.168566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 17 03:00:22.169507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 17 03:00:22.170537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Oct 17 03:00:22.171465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 03:00:22.174167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 17 03:00:22.176447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'id': 'b64007a317b64944b67f10326ae77128', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 17 03:00:22.178883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:22.180992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.183328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 412/810] 10.222.0.20 () {60 vars in 1137 bytes} [Mon Oct 17 03:00:22 2022] POST /identity/v3/domains => generated 190 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:22.185052 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.229232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:22.276901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.289548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ae287-d671-49cd-a64a-b20d4e94f87d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.327109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.327735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.328237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.328512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.340585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:22.340944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.342770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:22.359324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:22.360544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:22.361669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:22.361669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:22.361669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:22.364013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 399/811] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:22.367036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.386389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ba743-a18b-46e7-99aa-990471110252 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.421914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.422574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.422851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.423121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.435192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:22.440447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:22.441416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:22.442329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 413/812] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:22.447390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.475190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:22.479737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b0859-fd8f-47ee-90b3-ddfbb4fb2d02 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.517793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.518412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.518693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.518972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.519699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:22.520046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.521407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.535260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 400/813] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:22.547958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117963-668e-4e17-a59e-6b2bcc9266ad None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.576766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:22.586986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.587759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.588178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.588729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.589509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:22.589918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.591440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.607676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 414/814] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:22.609613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.722683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b6d47-d227-4049-914b-551e8d5bc5a3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.760652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.761287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.761568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.761844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] PATH_INFO: `/v3/users/44d5765597f44c5cb8620211ba5f8880` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.776179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] RBAC: Authorizing `identity:get_user(user_id=44d5765597f44c5cb8620211ba5f8880)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.777700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.779588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 401/815] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:22 2022] GET /identity/v3/users/44d5765597f44c5cb8620211ba5f8880 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:22.786077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.891603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5070-72c1-40e1-be0f-b584bfcfc98c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:22.924746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8862ae-d0fb-4592-89e2-0efb0d86dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:22.925362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8862ae-d0fb-4592-89e2-0efb0d86dace None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:22.925636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8862ae-d0fb-4592-89e2-0efb0d86dace None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:22.925932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8862ae-d0fb-4592-89e2-0efb0d86dace None admin] PATH_INFO: `/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:22.927580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8862ae-d0fb-4592-89e2-0efb0d86dace None admin] RBAC: Authorizing `identity:get_project(project_id=1bb33dd324104f1f8a681b0a01da9dd5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:22.929045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8862ae-d0fb-4592-89e2-0efb0d86dace None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:22.930646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 415/816] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:22 2022] GET /identity/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:22.936492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:22.954445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:23.036484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21630961-10ba-475b-87cb-87c1bef104a4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:23.068749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdb99e-85f7-487d-afd5-1ad0d2630ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:23.069395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdb99e-85f7-487d-afd5-1ad0d2630ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:23.069675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdb99e-85f7-487d-afd5-1ad0d2630ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:23.069946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdb99e-85f7-487d-afd5-1ad0d2630ee6 None admin] PATH_INFO: `/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5/users/44d5765597f44c5cb8620211ba5f8880/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:23.071831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdb99e-85f7-487d-afd5-1ad0d2630ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bb33dd324104f1f8a681b0a01da9dd5, user_id=44d5765597f44c5cb8620211ba5f8880, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:23.073291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdb99e-85f7-487d-afd5-1ad0d2630ee6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:23.085655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 402/817] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:00:22 2022] PUT /identity/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5/users/44d5765597f44c5cb8620211ba5f8880/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:00:24.256087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db697dce-680c-4787-87f2-8f967c73e7f0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:24.256611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db697dce-680c-4787-87f2-8f967c73e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:24.256611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db697dce-680c-4787-87f2-8f967c73e7f0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:24.257958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 416/818] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:24.263299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:24.263701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:24.263859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:24.281779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:24.282950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:24.348925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 403/819] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:24.613437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db697dce-680c-4787-87f2-8f967c73e7f0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:24.667056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:24.714646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db697dce-680c-4787-87f2-8f967c73e7f0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:24.748629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:24.749257 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:24.749539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:24.749811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:24.759946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:24.764711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:24.765810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:24.769038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 417/820] 10.222.0.20 () {56 vars in 1120 bytes} [Mon Oct 17 03:00:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:24.772412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:24.780419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:24.984553 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5756758-4dcb-454d-b027-6aed7e68fc29 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.017371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.017972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.018250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.018518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.019204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:25.020050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.021371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127b594-7dac-427d-8b04-bf9eead470d0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.033879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 404/821] 10.222.0.20 () {56 vars in 1115 bytes} [Mon Oct 17 03:00:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:25.035909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.137583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b3ee1-cb47-4b45-a98e-b87414631f67 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.150981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.172781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.173410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.173697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.173969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.184590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.186067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.188858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2464-5f10-449d-b4a9-c486128c4c51 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.189203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2464-5f10-449d-b4a9-c486128c4c51 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.189400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e2464-5f10-449d-b4a9-c486128c4c51 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.190857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 405/822] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:00:25.195549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.195831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.196132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:25.200738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:25.201687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:25.207046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:25.207046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:25.207046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:25.207046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 418/823] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:25.208080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.218128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:25.219262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:25.279325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.285699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 406/824] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:25.304481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ce603-ec42-4818-b536-37fb3bee2619 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.337494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.338085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.338363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.338658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.339276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:25.339573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.340958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.352177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 419/825] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:25.357592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.450941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a165-b9c4-472f-b0dc-b8d4094db3a8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.482392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.482954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.483220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.483485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.490669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.492372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:00:25.503318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:25.505067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:25.506121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 407/826] 10.222.0.20 () {56 vars in 1093 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:25.510720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.535248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.558499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.610490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf672c6-9992-46f1-90d6-0c228d545c9f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.618955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.643474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.644180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.644483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.645260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.645971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:25.646271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.647970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.661221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c295b2-6e83-4a61-9352-ab582d62e343 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.665593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 420/827] 10.222.0.20 () {56 vars in 1133 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:25.671243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.697197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.697820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.698104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.698374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.709018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:25.713774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:25.714869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:25.715797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:25.719963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 408/828] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:25.720803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.749956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.768947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133585e2-4145-49bd-a426-9b1965acd2c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.802434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.803030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.803309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.803588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.821358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb7bac-9568-4df5-a436-f2992fdbb324 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.838988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.857691 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:25.858280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:25.858556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:25.858825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:25.859471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:25.859767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.861199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.869733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 409/829] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:25.872775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:25.874237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:25.875581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:25.956490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:25.976296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d317-9343-40d4-927c-4a35cb078f2f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:25.976451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 421/830] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 03:00:25.982093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.010066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.010621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.010895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.011159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] PATH_INFO: `/v3/users/44d5765597f44c5cb8620211ba5f8880` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.012290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] RBAC: Authorizing `identity:get_user(user_id=44d5765597f44c5cb8620211ba5f8880)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.013697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.015249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 410/831] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/users/44d5765597f44c5cb8620211ba5f8880 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:26.020792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.067956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:26.078053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d662c-a11c-440a-81b9-761747a9b688 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.111811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.112455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.112736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.113060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.117084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a599614-7593-4e53-9ce3-5089b4cef757 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.123133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.124578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:00:26.139115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:26.140094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:00:26.140997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:00:26.140997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:00:26.140997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:26.140997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 422/832] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:26.145810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.149964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.150560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.150839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.151110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.178268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:26.217349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.218782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.242311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a14f99-f8b4-4a6e-81cd-3958def34c13 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.266024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:26.275608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.276248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.276530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.276804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.277434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:26.277736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.279083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.290084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 423/833] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:26.295643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.317566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 411/834] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 17 03:00:26.323096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.386461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:26.393115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0232a-850e-4b03-8853-36dae11f9068 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.420883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703acdcc-ce4d-4bf3-a0f3-089fde9de668 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.427239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.427855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.428168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.428444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.435456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.436933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:00:26.448065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:26.448942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:26.449989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 424/835] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:26.454858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.456552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.457802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.457966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.458232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] PATH_INFO: `/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.459343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] RBAC: Authorizing `identity:get_project(project_id=1bb33dd324104f1f8a681b0a01da9dd5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.460772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.467549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 412/836] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:26.468342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.485893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:26.552792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea4a0f-5ba2-42f4-9ff5-6150706c3f33 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.565375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695672-acb1-4e1c-b0c7-1b0c171b5952 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.586418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.587019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.587299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.587571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.588277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:26.588582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.589993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.600335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.600933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.601210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.601480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.601688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 425/837] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:26.602201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=1bb33dd324104f1f8a681b0a01da9dd5, user.id=44d5765597f44c5cb8620211ba5f8880) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:26.602504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.603927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40217e7-c037-4c19-811b-f09078107c36 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.608176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:26.617218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 413/838] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/role_assignments?user.id=44d5765597f44c5cb8620211ba5f8880&scope.project.id=1bb33dd324104f1f8a681b0a01da9dd5&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:26.624191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:26.714137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389362e3-6531-4961-9f94-786754a45a46 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:26.749355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:26.749969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:26.750250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:26.750523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:26.751252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] RBAC: Adding query filter params (role.id=2c18e03036df47a18914701e2fc3af99, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=b7b1497b5e4e4f77a92eba0c3d3b1cac) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:26.751562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:26.753056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2a2fe-6063-4312-a132-813e8a57ff27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:26.760032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 426/839] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:00:26 2022] GET /identity/v3/role_assignments?user.id=b7b1497b5e4e4f77a92eba0c3d3b1cac&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=2c18e03036df47a18914701e2fc3af99 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:28.746281 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f993-35f6-4b14-9f51-72c576e11f2b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:28.746833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f993-35f6-4b14-9f51-72c576e11f2b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:28.746833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4f993-35f6-4b14-9f51-72c576e11f2b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:28.748184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 414/840] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:28.753420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:28.753880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:28.754512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:28.772358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:28.773519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:28.836096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 427/841] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:29.100469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f993-35f6-4b14-9f51-72c576e11f2b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:29.178673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:29.198335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4f993-35f6-4b14-9f51-72c576e11f2b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:29.229541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62a5d0-5974-49e4-bea3-845db97f2134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:29.230146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62a5d0-5974-49e4-bea3-845db97f2134 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:29.230421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62a5d0-5974-49e4-bea3-845db97f2134 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:29.230689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62a5d0-5974-49e4-bea3-845db97f2134 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:29.231771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62a5d0-5974-49e4-bea3-845db97f2134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:29.233203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62a5d0-5974-49e4-bea3-845db97f2134 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:29.234714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 415/842] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:29.240946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:29.250973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:29.337721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea60726-724a-43dc-a4a6-48ec877b4ebe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:29.369960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f4516-663f-41ec-8955-2423b5b23842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:29.370516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4516-663f-41ec-8955-2423b5b23842 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:29.370791 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4516-663f-41ec-8955-2423b5b23842 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:29.371057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f4516-663f-41ec-8955-2423b5b23842 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:29.371692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f4516-663f-41ec-8955-2423b5b23842 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:29.373135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f4516-663f-41ec-8955-2423b5b23842 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:29.394270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 428/843] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 03:00:29 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:00:31.512595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7efe5a-e51f-4060-997f-16c6c0d852ef None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:31.513123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7efe5a-e51f-4060-997f-16c6c0d852ef None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:31.513123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7efe5a-e51f-4060-997f-16c6c0d852ef None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:31.514437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 416/844] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:31.519964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:31.520406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:31.520500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:31.538627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:31.539800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:31.594934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:31.604338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 429/845] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:31.867452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7efe5a-e51f-4060-997f-16c6c0d852ef None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:31.963321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7efe5a-e51f-4060-997f-16c6c0d852ef None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:31.995578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:31.996216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:31.996494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:31.996764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] PATH_INFO: `/v3/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:31.998124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] RBAC: Authorizing `identity:get_role(role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:31.999475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:32.000796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 417/846] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:31 2022] GET /identity/v3/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:32.006985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:32.100590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f865a-9ded-4ef2-93e0-2871c18fbcb0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:32.133273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:32.133823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:32.134099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:32.134370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] PATH_INFO: `/v3/users/605339e11ad14b2c9707e032af3efb20` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:32.146986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] RBAC: Authorizing `identity:get_user(user_id=605339e11ad14b2c9707e032af3efb20)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:32.148441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:32.149985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 430/847] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:32 2022] GET /identity/v3/users/605339e11ad14b2c9707e032af3efb20 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:32.155525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:32.172612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:32.250243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935b9fd-e729-4d50-8eea-40ae99748c17 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:32.282042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c88342-50d2-4650-8f32-efe44ed08188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:32.282640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88342-50d2-4650-8f32-efe44ed08188 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:32.282915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88342-50d2-4650-8f32-efe44ed08188 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:32.283183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c88342-50d2-4650-8f32-efe44ed08188 None admin] PATH_INFO: `/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:32.284289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c88342-50d2-4650-8f32-efe44ed08188 None admin] RBAC: Authorizing `identity:get_project(project_id=1bb33dd324104f1f8a681b0a01da9dd5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:32.285721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c88342-50d2-4650-8f32-efe44ed08188 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:32.287279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 418/848] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:32 2022] GET /identity/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:32.293239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:32.344133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:32.390087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5363a08-ad7f-4397-8e3d-92b233263171 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:32.422011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28937865-7ee6-42f5-ad37-3082940e0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:32.422654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937865-7ee6-42f5-ad37-3082940e0ce4 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:32.422938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937865-7ee6-42f5-ad37-3082940e0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:32.423212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28937865-7ee6-42f5-ad37-3082940e0ce4 None admin] PATH_INFO: `/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5/users/605339e11ad14b2c9707e032af3efb20/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:32.425848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28937865-7ee6-42f5-ad37-3082940e0ce4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bb33dd324104f1f8a681b0a01da9dd5, user_id=605339e11ad14b2c9707e032af3efb20, role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:32.427319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28937865-7ee6-42f5-ad37-3082940e0ce4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:32.439691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 431/849] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:00:32 2022] PUT /identity/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5/users/605339e11ad14b2c9707e032af3efb20/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:00:34.513068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9d227-9c5f-4e84-a11b-de2b9c4cad6c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:34.513617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9d227-9c5f-4e84-a11b-de2b9c4cad6c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:34.513617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9d227-9c5f-4e84-a11b-de2b9c4cad6c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:34.514923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 419/850] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:34.520961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:34.521403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:34.521521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:34.539887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:34.541084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:34.605062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 432/851] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:34.867359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9d227-9c5f-4e84-a11b-de2b9c4cad6c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:34.947563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:34.964592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9d227-9c5f-4e84-a11b-de2b9c4cad6c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:34.997546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:34.998157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:34.998433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:34.998699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] PATH_INFO: `/v3/roles/82925f6f46954c11888eaaf2678ac2e1` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:35.000071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] RBAC: Authorizing `identity:get_role(role_id=82925f6f46954c11888eaaf2678ac2e1)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:35.001412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:35.002691 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 420/852] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:34 2022] GET /identity/v3/roles/82925f6f46954c11888eaaf2678ac2e1 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:35.008427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:35.049553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:35.105554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee9602-bcd1-4329-9211-0652f0c1b81c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:35.139362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:35.139976 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:35.140256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:35.140527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] PATH_INFO: `/v3/users/605339e11ad14b2c9707e032af3efb20` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:35.141628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] RBAC: Authorizing `identity:get_user(user_id=605339e11ad14b2c9707e032af3efb20)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:35.143034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:35.145129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 433/853] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:35 2022] GET /identity/v3/users/605339e11ad14b2c9707e032af3efb20 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:35.150834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:35.247024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6b772-7106-44fd-a572-f78e60d38fbe None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:35.279214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:35.279794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:35.280100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:35.280369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:35.299910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:35.344113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:35.345525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:35.437702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 421/854] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:00:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 03:00:35.444090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:35.539274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41567c9-d1b6-4b39-9fb8-f5c5f79b7a48 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:35.549401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:35.572678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba028f-3918-4ae4-aadf-42f9edb2d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:35.573292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba028f-3918-4ae4-aadf-42f9edb2d8da None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:35.573571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba028f-3918-4ae4-aadf-42f9edb2d8da None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:35.573839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba028f-3918-4ae4-aadf-42f9edb2d8da None admin] PATH_INFO: `/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:35.574931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba028f-3918-4ae4-aadf-42f9edb2d8da None admin] RBAC: Authorizing `identity:get_project(project_id=1bb33dd324104f1f8a681b0a01da9dd5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:35.576379 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba028f-3918-4ae4-aadf-42f9edb2d8da None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:35.577956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 434/855] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:35 2022] GET /identity/v3/projects/1bb33dd324104f1f8a681b0a01da9dd5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:35.584752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:35.635223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:35.680354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020b595-3945-4819-a73b-6fc414282578 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:35.713591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:35.714125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:35.714403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:35.714672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:35.715379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] RBAC: Adding query filter params (role.id=82925f6f46954c11888eaaf2678ac2e1, scope.project.id=1bb33dd324104f1f8a681b0a01da9dd5, user.id=605339e11ad14b2c9707e032af3efb20) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:35.715684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:35.717126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254377d2-fda8-4de8-82dc-e61c0daa7f0b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:35.722635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 422/856] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:00:35 2022] GET /identity/v3/role_assignments?user.id=605339e11ad14b2c9707e032af3efb20&scope.project.id=1bb33dd324104f1f8a681b0a01da9dd5&role.id=82925f6f46954c11888eaaf2678ac2e1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:37.812211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad85c24-4eb3-4fa9-94c9-bf6f0da65ae7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:37.812738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad85c24-4eb3-4fa9-94c9-bf6f0da65ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:37.812829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad85c24-4eb3-4fa9-94c9-bf6f0da65ae7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:37.814100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 435/857] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:37.819727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:37.820128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:37.820297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:37.838351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:37.839514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:37.901977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 423/858] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:38.164952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad85c24-4eb3-4fa9-94c9-bf6f0da65ae7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:38.261990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad85c24-4eb3-4fa9-94c9-bf6f0da65ae7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:38.293226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922333bb-434a-4c07-a33f-c38d67ee71ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:38.293832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922333bb-434a-4c07-a33f-c38d67ee71ea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:38.294109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922333bb-434a-4c07-a33f-c38d67ee71ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:38.294376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922333bb-434a-4c07-a33f-c38d67ee71ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:38.295454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922333bb-434a-4c07-a33f-c38d67ee71ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:38.296887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922333bb-434a-4c07-a33f-c38d67ee71ea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:38.298399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 436/859] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:38.304533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:38.348160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:38.398628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7137-ae59-4be3-bf3e-7a3baa7fe639 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:38.430642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce805e-bab6-479f-8c4f-1f4787af4c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:38.431177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce805e-bab6-479f-8c4f-1f4787af4c96 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:38.431448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce805e-bab6-479f-8c4f-1f4787af4c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:38.431712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce805e-bab6-479f-8c4f-1f4787af4c96 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:38.432373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce805e-bab6-479f-8c4f-1f4787af4c96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:38.433764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce805e-bab6-479f-8c4f-1f4787af4c96 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:38.458675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 424/860] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:00:38 2022] POST /identity/v3/projects => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:40.609357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53904-62ae-4a7d-b2fc-0039eea471be None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:40.609911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53904-62ae-4a7d-b2fc-0039eea471be None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:40.609911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce53904-62ae-4a7d-b2fc-0039eea471be None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:40.611233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 437/861] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:40.617263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:40.617632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:40.617809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:40.636001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:40.637167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:40.699408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 425/862] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:40.968333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53904-62ae-4a7d-b2fc-0039eea471be None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:41.014861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:41.066730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce53904-62ae-4a7d-b2fc-0039eea471be None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:41.099766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927db475-12c2-4f87-b360-bc79db983224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:41.100411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db475-12c2-4f87-b360-bc79db983224 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:41.100694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db475-12c2-4f87-b360-bc79db983224 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:41.100966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927db475-12c2-4f87-b360-bc79db983224 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:41.102058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db475-12c2-4f87-b360-bc79db983224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:41.103482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927db475-12c2-4f87-b360-bc79db983224 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:41.105067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 438/863] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:00:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:41.110718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:41.137445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:41.207977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847f4bf-7937-48b8-b178-37d615ef7f2d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:41.240138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a72490-d939-4c45-8f4b-1aedd21d97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:41.240665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a72490-d939-4c45-8f4b-1aedd21d97bd None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:41.241199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a72490-d939-4c45-8f4b-1aedd21d97bd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:41.241470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a72490-d939-4c45-8f4b-1aedd21d97bd None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:41.242109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a72490-d939-4c45-8f4b-1aedd21d97bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:41.243515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a72490-d939-4c45-8f4b-1aedd21d97bd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:41.264534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 426/864] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 03:00:41 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:43.407972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4354dd0-9136-4ff6-8705-ddc372822911 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:43.408563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4354dd0-9136-4ff6-8705-ddc372822911 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:43.408563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4354dd0-9136-4ff6-8705-ddc372822911 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:43.409885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 439/865] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:43.415192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:43.415584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:43.415746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:43.434538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:43.435702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:43.500641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 427/866] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:43.769424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4354dd0-9136-4ff6-8705-ddc372822911 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:43.866631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4354dd0-9136-4ff6-8705-ddc372822911 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:43.880659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:43.900740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:43.901349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:43.901628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:43.901901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:43.911617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:43.916366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:43.917326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:43.918222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 440/867] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:00:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:43.923594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:43.937950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:44.020215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb8b0f-e9ea-471f-ac5b-7f48a9b4adac None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:44.052580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:44.053173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:44.053447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:44.053713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:44.054355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:44.054650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:44.056025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:44.063552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 428/868] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:00:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:44.069407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:44.165005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136dccd-adfa-4f88-99cd-e9921a5b6f86 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:44.196574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:44.197173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:44.197452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:44.197719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] PATH_INFO: `/v3/users/59fb803c5a2c4b4c9ace0eb4041ebfb2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:44.211113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] RBAC: Authorizing `identity:get_user(user_id=59fb803c5a2c4b4c9ace0eb4041ebfb2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:44.212561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:44.214126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 441/869] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:44 2022] GET /identity/v3/users/59fb803c5a2c4b4c9ace0eb4041ebfb2 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:44.219800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:44.293932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:44.315784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26139f-b9e9-459b-901b-3b9ceb7110c0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:44.347476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283d502-0d4b-4781-afe4-b45aeadb4c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:44.348113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d502-0d4b-4781-afe4-b45aeadb4c93 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:44.348390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d502-0d4b-4781-afe4-b45aeadb4c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:44.348657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d502-0d4b-4781-afe4-b45aeadb4c93 None admin] PATH_INFO: `/v3/projects/9a55b3bf8ed040b5a86da625cdb8b35f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:44.349751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283d502-0d4b-4781-afe4-b45aeadb4c93 None admin] RBAC: Authorizing `identity:get_project(project_id=9a55b3bf8ed040b5a86da625cdb8b35f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:44.351157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283d502-0d4b-4781-afe4-b45aeadb4c93 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:44.352776 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 429/870] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:44 2022] GET /identity/v3/projects/9a55b3bf8ed040b5a86da625cdb8b35f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:44.358645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:44.389707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:44.455696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30acb-4320-4593-b4fa-65eb403f3606 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:44.488247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca03fc-481c-419a-89a1-9ee0960d9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:44.488878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca03fc-481c-419a-89a1-9ee0960d9250 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:44.489162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca03fc-481c-419a-89a1-9ee0960d9250 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:44.489436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca03fc-481c-419a-89a1-9ee0960d9250 None admin] PATH_INFO: `/v3/projects/9a55b3bf8ed040b5a86da625cdb8b35f/users/59fb803c5a2c4b4c9ace0eb4041ebfb2/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:44.491575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca03fc-481c-419a-89a1-9ee0960d9250 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a55b3bf8ed040b5a86da625cdb8b35f, user_id=59fb803c5a2c4b4c9ace0eb4041ebfb2, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:44.493033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca03fc-481c-419a-89a1-9ee0960d9250 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:44.504763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 442/871] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:00:44 2022] PUT /identity/v3/projects/9a55b3bf8ed040b5a86da625cdb8b35f/users/59fb803c5a2c4b4c9ace0eb4041ebfb2/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:00:46.587426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171b892-6bdd-4c37-828c-4ab5373f9f38 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:46.587974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171b892-6bdd-4c37-828c-4ab5373f9f38 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:46.587974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171b892-6bdd-4c37-828c-4ab5373f9f38 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:46.589316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 430/872] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:46.594443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:46.594818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:46.595053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:46.613270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:46.614439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:46.678819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 443/873] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 17 03:00:46.945057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171b892-6bdd-4c37-828c-4ab5373f9f38 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:47.041793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171b892-6bdd-4c37-828c-4ab5373f9f38 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:47.073630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:47.074235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:47.074510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:47.074775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:47.084384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:47.089033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:47.090132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:00:47.091004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 431/874] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:00:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:00:47.096027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:47.120516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:47.193793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a09ce-f19c-478e-9da3-aa8f8cdbfe6f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:47.226690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:47.227220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:47.227497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:47.227766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:47.228437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:47.228733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:47.230078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:47.237730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 444/875] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:00:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:47.244074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:47.248295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:47.340889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645899b-5e9f-4e5c-83f8-76c41d228208 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:47.373689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:47.374289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:47.374569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:47.374842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] PATH_INFO: `/v3/users/59fb803c5a2c4b4c9ace0eb4041ebfb2` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:47.375950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] RBAC: Authorizing `identity:get_user(user_id=59fb803c5a2c4b4c9ace0eb4041ebfb2)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:47.377408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:47.379011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 432/876] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:47 2022] GET /identity/v3/users/59fb803c5a2c4b4c9ace0eb4041ebfb2 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:47.384676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:47.465582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:47.482264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61fa9b-18f9-49a9-a2ba-eefec694a4e2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:47.514048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:47.514633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:47.514910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:47.515180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:47.579235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:47.580679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:47.658443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:47.674786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 445/877] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:00:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 03:00:47.680621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:47.747353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:47.775196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd363-8c73-41df-a744-81314bbfab4f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:47.807606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a55c6-ba7a-47fe-8265-b0b72c309ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:47.808235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a55c6-ba7a-47fe-8265-b0b72c309ffc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:47.808509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a55c6-ba7a-47fe-8265-b0b72c309ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:47.808773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a55c6-ba7a-47fe-8265-b0b72c309ffc None admin] PATH_INFO: `/v3/projects/9a55b3bf8ed040b5a86da625cdb8b35f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:47.809848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a55c6-ba7a-47fe-8265-b0b72c309ffc None admin] RBAC: Authorizing `identity:get_project(project_id=9a55b3bf8ed040b5a86da625cdb8b35f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:47.811257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a55c6-ba7a-47fe-8265-b0b72c309ffc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:47.812850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 433/878] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:47 2022] GET /identity/v3/projects/9a55b3bf8ed040b5a86da625cdb8b35f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:47.818945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:47.913992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b74fd-4821-45d1-9672-f8635ad3acf2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:47.945823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:47.946409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:47.946691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:47.946957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:47.947664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=9a55b3bf8ed040b5a86da625cdb8b35f, user.id=59fb803c5a2c4b4c9ace0eb4041ebfb2) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:47.948002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:47.949423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c31b5f-108a-4039-9fab-fb2aa2fd33f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:47.955024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 446/879] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:00:47 2022] GET /identity/v3/role_assignments?user.id=59fb803c5a2c4b4c9ace0eb4041ebfb2&scope.project.id=9a55b3bf8ed040b5a86da625cdb8b35f&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:00:50.052054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5de08-5218-4a98-95d8-45a93bcdaf34 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:50.052588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5de08-5218-4a98-95d8-45a93bcdaf34 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:50.052588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5de08-5218-4a98-95d8-45a93bcdaf34 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:50.053956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 434/880] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:50.059066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bc331-4c0e-450a-bcdc-aa0737eb5c52 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:50.059483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bc331-4c0e-450a-bcdc-aa0737eb5c52 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:50.059595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729bc331-4c0e-450a-bcdc-aa0737eb5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:50.077963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-729bc331-4c0e-450a-bcdc-aa0737eb5c52 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:50.079129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-729bc331-4c0e-450a-bcdc-aa0737eb5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:50.120788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:50.143476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 447/881] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:50.406600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5de08-5218-4a98-95d8-45a93bcdaf34 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:50.502297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5de08-5218-4a98-95d8-45a93bcdaf34 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:50.534520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b5dc0-852e-486c-9935-e57eb323a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:50.535103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5dc0-852e-486c-9935-e57eb323a941 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:50.535376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5dc0-852e-486c-9935-e57eb323a941 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:50.535648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5dc0-852e-486c-9935-e57eb323a941 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:50.536334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b5dc0-852e-486c-9935-e57eb323a941 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:50.537668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b5dc0-852e-486c-9935-e57eb323a941 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:50.547153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:50.553736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 435/882] 10.222.0.20 () {60 vars in 1138 bytes} [Mon Oct 17 03:00:50 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:52.716629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9248bc-54ee-42fc-a90b-350cdccb801c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:52.717211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9248bc-54ee-42fc-a90b-350cdccb801c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:52.717211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9248bc-54ee-42fc-a90b-350cdccb801c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:52.718492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 448/883] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:52.724259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:52.724658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:52.724816 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:52.742600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:52.743768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:52.806698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 436/884] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:53.073839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9248bc-54ee-42fc-a90b-350cdccb801c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:53.171191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9248bc-54ee-42fc-a90b-350cdccb801c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:53.204230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24949f-914c-4cf0-b598-033163a7a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:53.204842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24949f-914c-4cf0-b598-033163a7a56f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:53.205120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24949f-914c-4cf0-b598-033163a7a56f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:53.205392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24949f-914c-4cf0-b598-033163a7a56f None admin] PATH_INFO: `/v3/domains/9358d03c14294a4f85119eedd1029463` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:53.215317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24949f-914c-4cf0-b598-033163a7a56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=9358d03c14294a4f85119eedd1029463)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:53.216762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24949f-914c-4cf0-b598-033163a7a56f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:53.218309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 449/885] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Oct 17 03:00:53 2022] GET /identity/v3/domains/9358d03c14294a4f85119eedd1029463 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:53.224396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:53.318419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a3dd9-6b81-49b3-b3d5-bcd8e2f0f6d6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:53.344781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:53.350387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7057-3bc3-4b5e-b653-860983da4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:53.350978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7057-3bc3-4b5e-b653-860983da4144 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:53.351254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7057-3bc3-4b5e-b653-860983da4144 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:53.351521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7057-3bc3-4b5e-b653-860983da4144 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:53.352196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7057-3bc3-4b5e-b653-860983da4144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:53.353600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7057-3bc3-4b5e-b653-860983da4144 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:53.379237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 437/886] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:00:53 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:55.506090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799d30-1a49-4bf1-8b66-1b773c226652 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:55.506624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799d30-1a49-4bf1-8b66-1b773c226652 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:55.506624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799d30-1a49-4bf1-8b66-1b773c226652 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:55.508030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 450/887] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:55.513371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:55.513776 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:55.513921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:55.531651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:55.532863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:55.596959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 438/888] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:55.865961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799d30-1a49-4bf1-8b66-1b773c226652 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:55.906130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:55.966075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799d30-1a49-4bf1-8b66-1b773c226652 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:55.999099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1aab7-29bf-44cf-b7cc-6aca84b70288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:55.999719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1aab7-29bf-44cf-b7cc-6aca84b70288 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:56.000033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1aab7-29bf-44cf-b7cc-6aca84b70288 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:56.000312 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1aab7-29bf-44cf-b7cc-6aca84b70288 None admin] PATH_INFO: `/v3/domains/9358d03c14294a4f85119eedd1029463` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:56.001416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1aab7-29bf-44cf-b7cc-6aca84b70288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9358d03c14294a4f85119eedd1029463)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:56.003394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1aab7-29bf-44cf-b7cc-6aca84b70288 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:56.004976 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 451/889] 10.222.0.20 () {56 vars in 1183 bytes} [Mon Oct 17 03:00:55 2022] GET /identity/v3/domains/9358d03c14294a4f85119eedd1029463 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:56.010750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:56.105293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6969877-ca1a-4777-81d6-a6fa28f0757f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:56.118122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:56.139818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b623a-262d-4d61-bdd6-c7d3c69a3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:56.140443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b623a-262d-4d61-bdd6-c7d3c69a3c6f None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:56.140744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b623a-262d-4d61-bdd6-c7d3c69a3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:56.141014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b623a-262d-4d61-bdd6-c7d3c69a3c6f None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:56.141662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b623a-262d-4d61-bdd6-c7d3c69a3c6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:56.143669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b623a-262d-4d61-bdd6-c7d3c69a3c6f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:56.163367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 439/890] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 03:00:56 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:00:58.303007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a449-bceb-49aa-a37f-0b3ae6af52f5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:58.303537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a449-bceb-49aa-a37f-0b3ae6af52f5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:58.303537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1a449-bceb-49aa-a37f-0b3ae6af52f5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:58.304952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 452/891] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:00:58.310096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:58.310508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:58.310645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:58.329005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:00:58.330182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:00:58.394136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 440/892] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:00:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:00:58.666767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a449-bceb-49aa-a37f-0b3ae6af52f5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:58.767340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1a449-bceb-49aa-a37f-0b3ae6af52f5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:58.774912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:58.800726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:58.801336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:58.801613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:58.801882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:58.811421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:00:58.816698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:00:58.817865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:00:58.818964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 453/893] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:00:58.823857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:58.915458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:58.919420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefb43a-4dfa-4cd0-80b5-c9d1e000a845 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:58.955073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:58.956250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:58.956533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:58.956802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:58.957469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:00:58.957771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:58.959131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:58.967155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 441/894] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:58.973013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:59.068961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035d95f-b268-4403-9432-ebbd3d28be37 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:59.101307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:59.101912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:59.102190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:59.102461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] PATH_INFO: `/v3/users/90615c826bf744308a57b022cc8cf265` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:59.115064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] RBAC: Authorizing `identity:get_user(user_id=90615c826bf744308a57b022cc8cf265)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:59.116759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:59.118307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 454/895] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:00:58 2022] GET /identity/v3/users/90615c826bf744308a57b022cc8cf265 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:59.124018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:59.217862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb79ffd-2e28-4f65-a6bf-56b97fceac2b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:59.249470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46127419-7a36-48a4-90e8-5dc0ded20f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:59.250076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46127419-7a36-48a4-90e8-5dc0ded20f24 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:59.250351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46127419-7a36-48a4-90e8-5dc0ded20f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:59.250617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46127419-7a36-48a4-90e8-5dc0ded20f24 None admin] PATH_INFO: `/v3/projects/8c0baeda1cc04eef96a490ab30f8053f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:59.251700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46127419-7a36-48a4-90e8-5dc0ded20f24 None admin] RBAC: Authorizing `identity:get_project(project_id=8c0baeda1cc04eef96a490ab30f8053f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:59.253696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46127419-7a36-48a4-90e8-5dc0ded20f24 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:59.255270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 442/896] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:00:59 2022] GET /identity/v3/projects/8c0baeda1cc04eef96a490ab30f8053f => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:00:59.261071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:00:59.285442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:00:59.356949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34364ec7-baaa-4ba7-8b89-2b02f8212e1a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:00:59.390436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6d6e5-a19e-4269-9dab-27b06ab48e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:00:59.391081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6d6e5-a19e-4269-9dab-27b06ab48e69 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:00:59.391361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6d6e5-a19e-4269-9dab-27b06ab48e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:00:59.391635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6d6e5-a19e-4269-9dab-27b06ab48e69 None admin] PATH_INFO: `/v3/projects/8c0baeda1cc04eef96a490ab30f8053f/users/90615c826bf744308a57b022cc8cf265/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:00:59.393560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6d6e5-a19e-4269-9dab-27b06ab48e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c0baeda1cc04eef96a490ab30f8053f, user_id=90615c826bf744308a57b022cc8cf265, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:00:59.394969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6d6e5-a19e-4269-9dab-27b06ab48e69 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:00:59.406900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 455/897] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:00:59 2022] PUT /identity/v3/projects/8c0baeda1cc04eef96a490ab30f8053f/users/90615c826bf744308a57b022cc8cf265/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:01:01.506768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6e4a-7d1d-4b52-9853-3b0125b85bdc None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:01.507365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6e4a-7d1d-4b52-9853-3b0125b85bdc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:01.507365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6e4a-7d1d-4b52-9853-3b0125b85bdc None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:01.508690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 443/898] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:01:01.513983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:01.514385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:01.514531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:01.532574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:01:01.534341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:01:01.597887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 456/899] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:01:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:01:01.866989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6e4a-7d1d-4b52-9853-3b0125b85bdc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:01.895413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:01.965714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6e4a-7d1d-4b52-9853-3b0125b85bdc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:01.998037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:01.998657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:01.998939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:01.999211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:02.009545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:01:02.014330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:01:02.019966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:01:02.021087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 444/900] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:01:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:01:02.022042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:02.036443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:02.117843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969a56c-7f80-44b2-8f19-aa3f59109574 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:02.151054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:02.151649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:02.151957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:02.152234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:02.152887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:01:02.153189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:02.154545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:02.162416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 457/901] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:01:02.168861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:02.252600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:02.264111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb9aad-387c-4b5e-90b5-49b64829f67e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:02.296881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:02.297485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:02.297764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:02.298036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] PATH_INFO: `/v3/users/90615c826bf744308a57b022cc8cf265` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:02.299159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=90615c826bf744308a57b022cc8cf265)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:02.300600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:02.302146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 445/902] 10.222.0.20 () {56 vars in 1177 bytes} [Mon Oct 17 03:01:02 2022] GET /identity/v3/users/90615c826bf744308a57b022cc8cf265 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:01:02.307763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:02.381049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:02.403226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0a6a5-9ab8-4144-9e96-ada552b35c58 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:02.435389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:02.436001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:02.436283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:02.436557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:02.500467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:02.501898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:02.573702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:02.596453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 458/903] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:01:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 03:01:02.602223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:02.697075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739f87b-0c35-449e-97d7-01cb5267e0e9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:02.728855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561af540-1664-4e06-b436-68966989204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:02.729457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561af540-1664-4e06-b436-68966989204c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:02.729734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561af540-1664-4e06-b436-68966989204c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:02.730003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561af540-1664-4e06-b436-68966989204c None admin] PATH_INFO: `/v3/projects/8c0baeda1cc04eef96a490ab30f8053f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:02.731087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561af540-1664-4e06-b436-68966989204c None admin] RBAC: Authorizing `identity:get_project(project_id=8c0baeda1cc04eef96a490ab30f8053f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:02.732514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561af540-1664-4e06-b436-68966989204c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:02.734081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 446/904] 10.222.0.20 () {56 vars in 1186 bytes} [Mon Oct 17 03:01:02 2022] GET /identity/v3/projects/8c0baeda1cc04eef96a490ab30f8053f => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:01:02.740013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:02.834522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32782fb0-ed1a-4318-ad39-4f508512d2e3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:02.866619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:02.867202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:02.867482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:02.867752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:02.868485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=8c0baeda1cc04eef96a490ab30f8053f, user.id=90615c826bf744308a57b022cc8cf265) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:01:02.868790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:02.870200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d80cf-ee3e-4027-8ca2-747b279571ec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:02.875684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 459/905] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:01:02 2022] GET /identity/v3/role_assignments?user.id=90615c826bf744308a57b022cc8cf265&scope.project.id=8c0baeda1cc04eef96a490ab30f8053f&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:01:12.724871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:12.873206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=80 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:57.597117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be968d5c-9b1f-4516-ad22-117591933175 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:57.597771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be968d5c-9b1f-4516-ad22-117591933175 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:57.597771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be968d5c-9b1f-4516-ad22-117591933175 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:57.599319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 447/906] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:01:57.606389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:57.606972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:57.607412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:57.630459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:01:57.633997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:01:57.726121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 460/907] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:01:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:01:57.995432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be968d5c-9b1f-4516-ad22-117591933175 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:58.124489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be968d5c-9b1f-4516-ad22-117591933175 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:58.168768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:58.169405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:58.169730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:58.170124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:58.183123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:58.185045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:01:58.202985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:01:58.208077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:01:58.209137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:01:58.209137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:01:58.209137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:01:58.209137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 448/908] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:01:58.210888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:58.337654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab54a29-f838-41b0-9f5a-16d5f5414e57 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:58.377624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:58.384397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:58.384989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:58.385316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:58.385601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:58.386283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:01:58.386658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:58.388032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf907a6-20a0-4d38-8261-e75914ab4e59 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:58.401268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 461/909] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:01:58.408674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:01:58.491021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:01:58.545300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14405a13-49dd-4e62-aa5f-164bea1c3a32 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:01:58.585714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34602da3-a6d5-4568-a15b-94cea6be8b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:01:58.586338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34602da3-a6d5-4568-a15b-94cea6be8b7e None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:01:58.586621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34602da3-a6d5-4568-a15b-94cea6be8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:01:58.586874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34602da3-a6d5-4568-a15b-94cea6be8b7e None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:01:58.587568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34602da3-a6d5-4568-a15b-94cea6be8b7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:01:58.589053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34602da3-a6d5-4568-a15b-94cea6be8b7e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:01:58.617818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 449/910] 10.222.0.20 () {60 vars in 1132 bytes} [Mon Oct 17 03:01:58 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:02:00.876219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aadbf-c4a0-4a01-b8e6-5af1da3e302e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:00.876784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aadbf-c4a0-4a01-b8e6-5af1da3e302e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:00.876784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aadbf-c4a0-4a01-b8e6-5af1da3e302e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:00.878340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 462/911] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:00.883732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:00.884223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:00.884345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:00.904748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:00.906023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:00.982920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 450/912] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:01.265352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aadbf-c4a0-4a01-b8e6-5af1da3e302e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:01.381213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aadbf-c4a0-4a01-b8e6-5af1da3e302e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:01.420014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:01.420781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:01.421067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:01.421402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:01.432397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:02:01.437876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:01.438850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 03:02:01.440056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:01.447072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 463/913] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 03:02:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:01.447215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:01.487745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:01.559373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46b382-7850-4176-9832-7a5678d5e854 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:01.598703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:01.599703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:01.600078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:01.600355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:01.601099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:01.601417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:01.602775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:01.616008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 451/914] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 03:02:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:01.617486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:01.680898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:01.746352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb1d6b-1046-4a8e-aa91-24cb224bf3a9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:01.788396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:01.789042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:01.789387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:01.789662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:01.806041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:01.807898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:01.823214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:01.824419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:01.825637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:01.825637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:01.825637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:01.831177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:01.831622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 464/915] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:01.939464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:01.942567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6444-c2b0-450a-9a10-a72c215bde2b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:01.986410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:01.987748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:01.987748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:01.987748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:01.988457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:01.988772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:01.990530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:02.008283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 452/916] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:02.009252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:02.130275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e8e36-5fed-4971-959e-5a645cae1dca None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:02.131054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:02.168391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:02.169098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:02.169387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:02.169660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:02.178527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:02.180118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:02:02.192798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:02.194191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:02.195182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 465/917] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:02:02.200303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:02.314752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c518-92b5-49d6-b2af-cec68628d585 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:02.351946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:02.353298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:02.353298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:02.353489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:02.354151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:02.354541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:02.356329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:02.378976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 453/918] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Oct 17 03:02:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:02.385193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:02.507053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec25ac4-55ce-408a-96c9-646f662f51fb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:02.557192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:02.557945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:02.558228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:02.558500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:02.570525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:02.572333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:02.587781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:02.588905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:02.589827 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:02.589827 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:02.589827 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:02.589827 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 466/919] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:02.595278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:02.615270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:02.700261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff85e6a-988a-4043-952d-fd9350281076 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:02.734901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:02.735676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:02.736148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:02.736522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:02.737249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:02.737646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:02.739101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:02.752226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 454/920] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:02.758013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:02.774693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:02.871744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb339-e2a9-40c9-9404-50afb448a953 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:02.908727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:02.909350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:02.909635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:02.909907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:02.917588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:02.919345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:02:02.933180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:02.939722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:02.940983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 467/921] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:02.941580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:03.045331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:03.070854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb868d-24a1-4ca9-a4f4-0dcad66d6e94 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:03.113954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:03.115104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:03.115409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:03.115682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:03.116404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:03.116707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:03.118262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02714ca6-38c2-4b9c-89e6-2892ac7a0127 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:03.137559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 455/922] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:03.139090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:03.216224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:03.244991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634bf458-402b-4e0b-aa6b-5f5459304d30 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:03.283247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c119e2b1-3223-432a-9138-d710ca1cdb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:03.283998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e2b1-3223-432a-9138-d710ca1cdb26 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:03.284285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e2b1-3223-432a-9138-d710ca1cdb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:03.284557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119e2b1-3223-432a-9138-d710ca1cdb26 None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/e2e2fbc7539a421f909f96d224953867/roles/7395f804f9cd432097538a1e00a88262` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:03.301979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e2b1-3223-432a-9138-d710ca1cdb26 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=e2e2fbc7539a421f909f96d224953867, role_id=7395f804f9cd432097538a1e00a88262)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:03.303776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c119e2b1-3223-432a-9138-d710ca1cdb26 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:03.323927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 468/923] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:02:03 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/e2e2fbc7539a421f909f96d224953867/roles/7395f804f9cd432097538a1e00a88262 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:02:05.629963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b2ef-8469-4dde-988e-67faf36fa8be None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:05.630567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b2ef-8469-4dde-988e-67faf36fa8be None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:05.630567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4b2ef-8469-4dde-988e-67faf36fa8be None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:05.635963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 456/924] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:02:05.638662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:05.639735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:05.640297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:05.663585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:05.665337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:05.744400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 469/925] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:06.026733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b2ef-8469-4dde-988e-67faf36fa8be None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:06.134403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4b2ef-8469-4dde-988e-67faf36fa8be None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:06.171031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:06.171665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:06.171974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:06.172253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:06.179331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:06.183515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:02:06.188996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:06.190255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:06.191123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 457/926] 10.222.0.20 () {56 vars in 1102 bytes} [Mon Oct 17 03:02:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:06.196625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:06.254120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:06.307058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2544e95-afeb-4945-9824-a3d9f002840a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:06.343977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:06.344588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:06.344865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:06.345135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:06.345798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:06.346115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:06.347479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:06.355813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 470/927] 10.222.0.20 () {56 vars in 1103 bytes} [Mon Oct 17 03:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:06.362900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:06.476193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7cd75-7633-4e4e-924d-09a3522655ec None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:06.516945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:06.517668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:06.517964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:06.518355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:06.536582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:06.538127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:06.553855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:06.555035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:06.555953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:06.555953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:06.555953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:06.555953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 458/928] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:02:06.562152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:06.678140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90558d07-67f5-406a-8e2f-728ddcd838a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:06.699739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:06.721021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:06.721648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:06.721919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:06.722199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:06.723017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:06.723349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:06.724858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:06.738175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 471/929] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:06.744689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:06.801184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:06.853504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28985bf-4522-43e6-bd3c-6f202daf845d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:06.891110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:06.891737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:06.892055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:06.892330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:06.899968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:06.901639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:02:06.913900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:06.915121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:06.916724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 459/930] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:06.921283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:07.032496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe7544-1a3a-48ee-b8d0-d27e295dd88e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:07.068782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:07.069319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:07.069596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:07.069863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:07.070572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:07.070871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:07.072354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:07.090840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 472/931] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Oct 17 03:02:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:07.097275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:07.205612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8a0ec-7c65-45ea-ab73-160fd38e4b48 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:07.217742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:07.244390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:07.245033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:07.245410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:07.245727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:07.320445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:07.321896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:07.428680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 460/932] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:02:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 03:02:07.434772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:07.472159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:07.542641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2d977-c01a-411a-8a9f-f52bb5d3a884 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:07.580215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:07.580925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:07.581296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:07.581657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:07.593828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:07.595448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:07.610614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:07.611797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:07.612773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:07.612773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:07.612773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:07.612773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 473/933] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:02:07.617743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:07.629536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:07.734658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017adb42-53e7-401d-bcd3-26c317e0e463 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:07.770723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:07.771432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:07.771666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:07.772038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:07.772777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:07.773161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:07.774748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:07.787694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 461/934] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:07.793421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:07.887619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:07.906586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e409bd-7e2a-460c-b358-09eb6075d817 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:07.943650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:07.944384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:07.944691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:07.944958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:07.952975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:07.954442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:02:07.967415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:07.968458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:07.969956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 474/935] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:07.974763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:08.047975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:08.080652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea4a9c-9e4c-4fc3-948a-6d533526c172 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:08.117190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:08.117786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:08.118064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:08.118333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:08.119012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:08.119313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:08.120861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfe23f-2f5e-4108-9e06-c7c95a3cea10 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:08.136594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 462/936] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:08.143279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:08.252143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59952a-7c30-4a25-81de-d7c8faef6194 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:08.287629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:08.288295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:08.288576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:08.288850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:08.289570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] RBAC: Adding query filter params (role.id=7395f804f9cd432097538a1e00a88262, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=e2e2fbc7539a421f909f96d224953867) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:08.289876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:08.291315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa6325-eda9-41d3-bdbf-6e72793ba2a9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:08.297260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 475/937] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:02:08 2022] GET /identity/v3/role_assignments?user.id=e2e2fbc7539a421f909f96d224953867&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=7395f804f9cd432097538a1e00a88262 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:10.515993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df072-50e3-4d2a-ad6a-db033b9fd057 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:10.516545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df072-50e3-4d2a-ad6a-db033b9fd057 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:10.516545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312df072-50e3-4d2a-ad6a-db033b9fd057 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:10.517887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 463/938] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:10.523367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:10.523787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:10.524063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:10.544053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:10.545507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:10.548318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:10.620038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 476/939] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:10.892509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df072-50e3-4d2a-ad6a-db033b9fd057 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:10.999183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312df072-50e3-4d2a-ad6a-db033b9fd057 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:11.028626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:11.035485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:11.036163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:11.036441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:11.036710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:11.048351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:02:11.053379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:11.054439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:11.055680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 464/940] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 17 03:02:11.060754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:11.176858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed8710-d9ba-4210-864a-be16a64d8d57 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:11.220041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:11.220811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:11.221202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:11.221582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:11.222613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:11.223072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:11.225161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:11.234370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 477/941] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:02:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:11.240730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:11.353643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61dee-d643-425b-a271-02c9e95f2f8c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:11.390903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:11.391691 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:11.392002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:11.392276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:11.402443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:11.404072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:11.419584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:11.420736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:11.427080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:11.427080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:11.427080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:11.427080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 465/942] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:11.427395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:11.430053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:11.535789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d975b-e79e-43c8-9323-496ead78756e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:11.572180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:11.572785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:11.573067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:11.573341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:11.573975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:11.574279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:11.575653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:11.588413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 478/943] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:11.594768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:11.643945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:11.707191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9e7f3-ea94-49ae-a76d-b2c0b7078d67 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:11.742956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:11.743605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:11.743865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:11.744171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:11.752092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:11.753766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:02:11.767771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:11.769347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:11.770581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 466/944] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:11.775104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:11.847418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:11.889240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8a660-3409-4580-891d-bc6031ead998 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:11.927352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:11.928084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:11.928345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:11.928621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:11.929340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:11.929647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:11.931069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:11.952501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 479/945] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Oct 17 03:02:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:11.958782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:12.069797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a6da2-4122-43d5-9630-5f51fefb2c53 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:12.071520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:12.108577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:12.109203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:12.109480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:12.109746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:12.121775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:12.123606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:12.138345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:12.139510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:12.140469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:12.140469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:12.140469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:12.140469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 467/946] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:12.146208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:12.255215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056de80-3e1c-4702-bf5c-2aac505785c5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:12.277033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:12.294154 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:12.295292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:12.295572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:12.295909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:12.296601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:12.296948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:12.298428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:12.317047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 480/947] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:12.318198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:12.422155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981cde7-a29e-4a0a-85b4-38e4bc4224c1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:12.460990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:12.461660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:12.461940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:12.462252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:12.469705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:12.471138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:02:12.484752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:12.491305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:12.492226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 468/948] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:02:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:12.492843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:12.605243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bcf35-40ab-450d-9b44-add67aaa2830 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:12.640576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:12.641184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:12.641912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:12.641912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:12.642389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:12.642692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:12.644188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defec9a6-deea-479c-80be-4f2f47a69f92 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:12.659281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 481/949] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:02:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:12.666557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:12.685509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:12.783189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c8b7-4a98-45d2-9c8a-2120a9c08cbb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:12.829211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad79b0e-90d0-49b6-a1bd-ccaf50e5eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:12.829891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad79b0e-90d0-49b6-a1bd-ccaf50e5eb4a None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:12.830176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad79b0e-90d0-49b6-a1bd-ccaf50e5eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:12.830451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad79b0e-90d0-49b6-a1bd-ccaf50e5eb4a None admin] PATH_INFO: `/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/e2e2fbc7539a421f909f96d224953867/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:12.832547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad79b0e-90d0-49b6-a1bd-ccaf50e5eb4a None admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b8d86d65341cfa9ae8ad5923e975e, user_id=e2e2fbc7539a421f909f96d224953867, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:12.834021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad79b0e-90d0-49b6-a1bd-ccaf50e5eb4a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:12.846284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 469/950] 10.222.0.20 () {58 vars in 1439 bytes} [Mon Oct 17 03:02:12 2022] PUT /identity/v3/projects/ed6b8d86d65341cfa9ae8ad5923e975e/users/e2e2fbc7539a421f909f96d224953867/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:02:15.154424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef57c7-23ec-4f2e-b195-da10153cad9e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:15.154949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef57c7-23ec-4f2e-b195-da10153cad9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:15.154949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef57c7-23ec-4f2e-b195-da10153cad9e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:15.156356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 482/951] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:15.161745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:15.162155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:15.162296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:15.182189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:15.183440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:15.255510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 470/952] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:15.566136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef57c7-23ec-4f2e-b195-da10153cad9e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:15.610160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:15.684269 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef57c7-23ec-4f2e-b195-da10153cad9e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:15.730698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:15.731408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:15.731764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:15.732137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:15.745121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 17 03:02:15.751660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:15.752817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:15.753868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 483/953] 10.222.0.20 () {56 vars in 1096 bytes} [Mon Oct 17 03:02:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:15.759618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:15.764621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:15.873859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb89e4-4f59-48ff-92ab-30b46dfc858b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:15.913510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:15.914127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:15.914410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:15.914686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:15.915391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:15.915714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:15.917192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:15.927529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 471/954] 10.222.0.20 () {56 vars in 1099 bytes} [Mon Oct 17 03:02:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:15.933852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:16.043603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:16.047287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c563a-b806-4b0d-bf5b-c4717a70c7cb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:16.082410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:16.083031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:16.083307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:16.083571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:16.094530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:16.097044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:16.113051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:16.114478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:16.115945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:16.115945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:16.115945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:16.115945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 484/955] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:16.120918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:16.187246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:16.223761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ffaa6-6371-4a80-a268-108a025d6aac None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:16.257672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:16.258314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:16.258609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:16.258869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:16.259504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:16.259807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:16.261203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:16.273797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 472/956] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:16.280152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:16.385683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ea5da-650d-40e1-ba84-c08c3d85827c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:16.424629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:16.425257 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:16.425537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:16.425811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:16.434044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:16.436506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 17 03:02:16.449302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:16.450351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:16.452045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 485/957] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:16.457210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:16.563754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe7867-a498-4c70-af64-7587df46bf01 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:16.591200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:16.600819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:16.601470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:16.601755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:16.602030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:16.602762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:16.603069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:16.604630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:16.630467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 473/958] 10.222.0.20 () {56 vars in 1143 bytes} [Mon Oct 17 03:02:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:02:16.631890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:16.648208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:16.743148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9a167-75e7-463d-a562-02f1012a3ede None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:16.782590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:16.783218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:16.783499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:16.783769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:16.856039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:16.858038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:16.874718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:16.966206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 486/959] 10.222.0.20 () {58 vars in 1282 bytes} [Mon Oct 17 03:02:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 17 03:02:16.972338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:17.075693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867673-2ebe-4272-9aff-4c55589f9bb2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:17.110147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:17.110785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:17.111062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:17.111330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:17.122325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:17.124361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 17 03:02:17.139910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:17.140962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 17 03:02:17.141857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 17 03:02:17.141857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 17 03:02:17.141857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:17.141857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 474/960] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:17.146774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:17.246151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76125de4-912f-490c-a4d1-bd8ac698b037 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:17.259755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:17.282805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:17.283438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:17.283673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:17.283969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:17.284621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:17.284929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:17.286275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:17.298685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 487/961] 10.222.0.20 () {56 vars in 1109 bytes} [Mon Oct 17 03:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:17.304426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:17.340550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:17.406870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1cb4-e47b-4902-a64d-8934d3142084 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:17.439182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:17.439803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:17.440114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:17.440384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:17.446758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:17.448213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 17 03:02:17.459111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:17.460165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: ERROR keystone.server.flask.application Oct 17 03:02:17.461211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 475/962] 10.222.0.20 () {56 vars in 1111 bytes} [Mon Oct 17 03:02:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:17.466673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:17.562618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e56ed-d73a-4d9e-a6e6-a9b2c8069acd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:17.594927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:17.595451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:17.595727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:17.596027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:17.596700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:17.596999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:17.598412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbee59-dd80-4d7f-8a1e-6968f1e3c0d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:17.609655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 488/963] 10.222.0.20 () {56 vars in 1148 bytes} [Mon Oct 17 03:02:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:17.615835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:17.713254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:17.720067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f779b-3dc6-43c8-915d-94d5bcfca90d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:17.751546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:17.752161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:17.752439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:17.752709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:17.753418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] RBAC: Adding query filter params (role.id=556d482df00b4d4bb6cadd282d1644b3, scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e, user.id=e2e2fbc7539a421f909f96d224953867) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:17.753719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:17.755124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611bf81-31fa-421a-8e11-3c21f1fd4e48 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:17.760918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 476/964] 10.222.0.20 () {56 vars in 1374 bytes} [Mon Oct 17 03:02:17 2022] GET /identity/v3/role_assignments?user.id=e2e2fbc7539a421f909f96d224953867&scope.project.id=ed6b8d86d65341cfa9ae8ad5923e975e&role.id=556d482df00b4d4bb6cadd282d1644b3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:19.877135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630da3-24e8-4c26-b034-8b130a224837 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:19.877690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630da3-24e8-4c26-b034-8b130a224837 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:19.877690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92630da3-24e8-4c26-b034-8b130a224837 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:19.879023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 489/965] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:19.884250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:19.884647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:19.884794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:19.902830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:19.904575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:19.967888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 477/966] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:20.231128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92630da3-24e8-4c26-b034-8b130a224837 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:20.261656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:20.330399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92630da3-24e8-4c26-b034-8b130a224837 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:20.362458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:20.363064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:20.363340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:20.363608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:20.364453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:20.365809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:20.374762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:20.380114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:20.381167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 490/967] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 03:02:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:20.382165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:20.467186 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:20.476827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439b1f3-c90c-4f94-93f8-e2a6395bd66a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:20.509796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:20.510393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:20.510676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:20.510952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:20.511574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:20.511900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:20.513842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc54348-7869-4ee1-a56a-b8ed9d6996cb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:20.518473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 478/968] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Oct 17 03:02:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:20.523998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:20.614483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:20.620394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5af58-928b-472f-9e52-ceea91a4161f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:20.656322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:20.656945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:20.657220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:20.657489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:20.658179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:20.658483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:20.659909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd7640-92f2-40ed-a405-f8f7d3765ca4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:20.664702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 491/969] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Oct 17 03:02:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:22.785628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d640-399c-4bd1-af97-722336cbc222 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:22.786178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d640-399c-4bd1-af97-722336cbc222 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:22.786178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920d640-399c-4bd1-af97-722336cbc222 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:22.787501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 479/970] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:22.792569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93908e41-afdd-4375-aa90-0d5e0e163caa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:22.792966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93908e41-afdd-4375-aa90-0d5e0e163caa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:22.793113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93908e41-afdd-4375-aa90-0d5e0e163caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:22.812544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-93908e41-afdd-4375-aa90-0d5e0e163caa None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:22.813707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-93908e41-afdd-4375-aa90-0d5e0e163caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:22.876635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 492/971] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:23.143259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d640-399c-4bd1-af97-722336cbc222 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:23.239505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920d640-399c-4bd1-af97-722336cbc222 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:23.272268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91a594-b178-4cdf-933c-14b5bfa32534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:23.272858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91a594-b178-4cdf-933c-14b5bfa32534 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:23.273138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91a594-b178-4cdf-933c-14b5bfa32534 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:23.273407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91a594-b178-4cdf-933c-14b5bfa32534 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:23.274056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91a594-b178-4cdf-933c-14b5bfa32534 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:23.275410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91a594-b178-4cdf-933c-14b5bfa32534 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:23.290853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 480/972] 10.222.0.20 () {60 vars in 1141 bytes} [Mon Oct 17 03:02:23 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:02:25.427973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f06464-096e-4180-a792-d9c1018aaf4d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:25.428542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f06464-096e-4180-a792-d9c1018aaf4d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:25.428542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f06464-096e-4180-a792-d9c1018aaf4d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:25.429834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 493/973] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:25.435665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:25.436121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:25.436249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:25.454486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:25.455660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:25.464577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:25.526840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 481/974] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:25.795452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f06464-096e-4180-a792-d9c1018aaf4d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:25.883362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:25.894380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f06464-096e-4180-a792-d9c1018aaf4d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:25.926762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:25.927368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:25.927643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:25.927933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:25.928499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:25.929849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:25.938295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:25.939532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:25.940706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 494/975] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 03:02:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:25.945617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:26.041149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb3be5-7962-45da-84dc-11d6e0884499 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:26.072549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:26.073085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:26.073361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:26.073628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:26.074238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:26.074532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:26.076448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:26.081305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 482/976] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Oct 17 03:02:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:26.087445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:26.183424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41255e6-3672-4420-b71e-fdacac233ce9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:26.215762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:26.216364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:26.216642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:26.216910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:26.217585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] RBAC: Adding query filter params (interface=public, service_id=6df1ae597a854517824df0aedd9d8711, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:26.217888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:26.219231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1c326-e4ed-4172-b11b-b7572abb7215 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:26.224139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 495/977] 10.222.0.20 () {56 vars in 1251 bytes} [Mon Oct 17 03:02:26 2022] GET /identity/v3/endpoints?service_id=6df1ae597a854517824df0aedd9d8711&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:26.229419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:26.233072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:26.325644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1aa30-854e-4faa-9e11-5b5403821152 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:26.356841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14850cf-ded9-4282-a228-a483a013432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:26.357425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14850cf-ded9-4282-a228-a483a013432a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:26.357699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14850cf-ded9-4282-a228-a483a013432a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:26.357966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14850cf-ded9-4282-a228-a483a013432a None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:26.358550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14850cf-ded9-4282-a228-a483a013432a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:26.359911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14850cf-ded9-4282-a228-a483a013432a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:26.366664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 483/978] 10.222.0.20 () {56 vars in 1087 bytes} [Mon Oct 17 03:02:26 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:02:28.472684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7566-fefe-4db8-b0d7-4276cc44a5ac None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:28.473210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7566-fefe-4db8-b0d7-4276cc44a5ac None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:28.473210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7566-fefe-4db8-b0d7-4276cc44a5ac None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:28.474548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 496/979] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:02:28.479894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:28.480276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:28.480441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:28.499010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:02:28.500225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:02:28.558360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:28.564540 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 484/980] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:02:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 17 03:02:28.845641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7566-fefe-4db8-b0d7-4276cc44a5ac None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:28.865204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:28.943775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7566-fefe-4db8-b0d7-4276cc44a5ac None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:28.976652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:28.977272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:28.977553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:28.977825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:28.978395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:28.979747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 17 03:02:28.989057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 17 03:02:28.990218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Oct 17 03:02:28.991251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 497/981] 10.222.0.20 () {56 vars in 1117 bytes} [Mon Oct 17 03:02:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 17 03:02:28.996194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:29.089698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbbdb-71ec-44e5-8b3d-f5cd72fcaaab None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:29.123170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:29.123732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:29.124046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:29.124323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:29.124944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:02:29.125246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:29.126609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3173ea-9464-4e6a-b656-922f125ce935 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:29.131582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 485/982] 10.222.0.20 () {56 vars in 1116 bytes} [Mon Oct 17 03:02:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:02:29.137677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:02:29.216597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:29.234330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de131c-3d01-4a99-b34a-b3fc9833c905 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:02:29.266929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452afb8-4d87-4eeb-bb5b-8e37dffe5435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:02:29.267516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452afb8-4d87-4eeb-bb5b-8e37dffe5435 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:02:29.267797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452afb8-4d87-4eeb-bb5b-8e37dffe5435 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:02:29.268099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452afb8-4d87-4eeb-bb5b-8e37dffe5435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:02:29.268755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452afb8-4d87-4eeb-bb5b-8e37dffe5435 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:02:29.270113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452afb8-4d87-4eeb-bb5b-8e37dffe5435 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:02:29.289109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 498/983] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:02:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:02:39.128719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=69 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:02:39.285290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:32.622963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700440-59ce-4bd7-b6fd-83010607e0e7 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:32.623441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700440-59ce-4bd7-b6fd-83010607e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:32.623519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700440-59ce-4bd7-b6fd-83010607e0e7 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:32.630096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3e33-ae2f-4ffa-91aa-938857a8c540 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:32.630497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3e33-ae2f-4ffa-91aa-938857a8c540 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:32.630638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc3e33-ae2f-4ffa-91aa-938857a8c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:32.634112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 486/984] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:32.774458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b6bc3e33-ae2f-4ffa-91aa-938857a8c540 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:32.775681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b6bc3e33-ae2f-4ffa-91aa-938857a8c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:32.919002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 499/985] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:03:33.213272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd611-bafe-4bfb-9778-e46cf2d8fecd None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:33.213909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd611-bafe-4bfb-9778-e46cf2d8fecd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:33.214386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd611-bafe-4bfb-9778-e46cf2d8fecd None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:33.216370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 487/986] 10.222.0.20 () {54 vars in 964 bytes} [Mon Oct 17 03:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:33.222680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98fcf-d785-4392-84c2-f4bb4c3c343f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:33.222981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98fcf-d785-4392-84c2-f4bb4c3c343f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:33.223261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d98fcf-d785-4392-84c2-f4bb4c3c343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:33.302767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-47d98fcf-d785-4392-84c2-f4bb4c3c343f None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:33.304121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-47d98fcf-d785-4392-84c2-f4bb4c3c343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:33.325467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:33.383276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 500/987] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Oct 17 03:03:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:33.392835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd611-bafe-4bfb-9778-e46cf2d8fecd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:33.395055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2d0bd611-bafe-4bfb-9778-e46cf2d8fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:33.521101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd611-bafe-4bfb-9778-e46cf2d8fecd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:33.605917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:33.606630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:33.607483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:33.607765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:33.609430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:33.672164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:33.728677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:33.730123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035e3cd-3167-41f0-99db-85b3132fa632 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:33.750316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 488/988] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:36.274362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a2a05-15a1-4f4a-887a-d1f9eda7a9ac None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:36.274872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a2a05-15a1-4f4a-887a-d1f9eda7a9ac None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:36.274965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a2a05-15a1-4f4a-887a-d1f9eda7a9ac None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:36.276284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 501/989] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:36.281480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fece-8c42-4abb-bc94-13f240fc0caa None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:36.281898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fece-8c42-4abb-bc94-13f240fc0caa None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:36.282024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7fece-8c42-4abb-bc94-13f240fc0caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:36.362311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b2b7fece-8c42-4abb-bc94-13f240fc0caa None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:36.363492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b2b7fece-8c42-4abb-bc94-13f240fc0caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:36.458083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 489/990] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:36.743370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a2a05-15a1-4f4a-887a-d1f9eda7a9ac None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:36.744945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d07a2a05-15a1-4f4a-887a-d1f9eda7a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:36.845089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a2a05-15a1-4f4a-887a-d1f9eda7a9ac None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:36.915543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:36.917966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:36.918803 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:36.919258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:36.919721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:36.921361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:37.027809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:37.029264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7406-12c3-4668-8f40-3878c8fd0df7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:37.047175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 502/991] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:39.471106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743053b-770c-4195-8c94-b842712365cf None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:39.471673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743053b-770c-4195-8c94-b842712365cf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:39.471673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743053b-770c-4195-8c94-b842712365cf None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:39.473034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 490/992] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:39.478725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1bf9-c248-4b6c-80d0-9a6e6f5beb69 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:39.479149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1bf9-c248-4b6c-80d0-9a6e6f5beb69 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:39.479250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb1bf9-c248-4b6c-80d0-9a6e6f5beb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:39.543593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-24fb1bf9-c248-4b6c-80d0-9a6e6f5beb69 None None] MFA Rules not processed for user `756f4309353f49bda9534cdd99dbb397`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:39.544825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-24fb1bf9-c248-4b6c-80d0-9a6e6f5beb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:39.594994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:39.639991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 503/993] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:39.926280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743053b-770c-4195-8c94-b842712365cf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:39.927837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c743053b-770c-4195-8c94-b842712365cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:39.938104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:40.032970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743053b-770c-4195-8c94-b842712365cf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:40.106103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:40.106701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:40.106980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:40.107251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:40.108868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:40.169410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:40.214633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:40.216072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dd08e-1484-4041-b332-66e4facb1c24 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:40.234645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 491/994] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:42.867258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b72b-8471-439f-988a-58f4feee4e1b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:42.867788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b72b-8471-439f-988a-58f4feee4e1b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:42.867788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755b72b-8471-439f-988a-58f4feee4e1b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:42.869174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 504/995] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:42.874578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8663-6b8c-43a1-a0dc-7c34b898e023 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:42.874977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8663-6b8c-43a1-a0dc-7c34b898e023 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:42.875114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8663-6b8c-43a1-a0dc-7c34b898e023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:42.938825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ca5d8663-6b8c-43a1-a0dc-7c34b898e023 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:42.940043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ca5d8663-6b8c-43a1-a0dc-7c34b898e023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:43.033582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 492/996] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:43.313464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b72b-8471-439f-988a-58f4feee4e1b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:43.314976 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a755b72b-8471-439f-988a-58f4feee4e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:43.416367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755b72b-8471-439f-988a-58f4feee4e1b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:43.489117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:43.489708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:43.489983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:43.490251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:43.492361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:43.498979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:43.597408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:43.598753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca817b66-7192-492f-bec1-2bd31436441a service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:43.617355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 505/997] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:46.421625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffc0e6-b22f-4216-8be6-5e7feb5ca1c4 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:46.422210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffc0e6-b22f-4216-8be6-5e7feb5ca1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:46.422210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ffc0e6-b22f-4216-8be6-5e7feb5ca1c4 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:46.423612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 493/998] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:46.430305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46db4d-50b4-469a-b425-9490e1b03665 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:46.430826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46db4d-50b4-469a-b425-9490e1b03665 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:46.430934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46db4d-50b4-469a-b425-9490e1b03665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:46.503480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fd46db4d-50b4-469a-b425-9490e1b03665 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:46.504765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fd46db4d-50b4-469a-b425-9490e1b03665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:46.565680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:46.606700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 506/999] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:46.888667 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffc0e6-b22f-4216-8be6-5e7feb5ca1c4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:46.890206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-81ffc0e6-b22f-4216-8be6-5e7feb5ca1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:46.911333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:46.999134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ffc0e6-b22f-4216-8be6-5e7feb5ca1c4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:47.072302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:47.072908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:47.073192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:47.073465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:47.075099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:47.146969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:47.185070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:47.186507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816143-8e90-4e45-bde2-11f37c309d2e service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:47.204910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 494/1000] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:49.397220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5cb18-9eb5-4ad4-8e24-01148498240f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:49.397742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5cb18-9eb5-4ad4-8e24-01148498240f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:49.397742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5cb18-9eb5-4ad4-8e24-01148498240f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:49.399095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 507/1001] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:49.404900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bde1d-7805-4837-974b-4a02d885f47a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:49.405310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bde1d-7805-4837-974b-4a02d885f47a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:49.405444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bde1d-7805-4837-974b-4a02d885f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:49.471251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a10bde1d-7805-4837-974b-4a02d885f47a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:49.472754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a10bde1d-7805-4837-974b-4a02d885f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:49.573293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 495/1002] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:49.872440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed411a-ebd9-471e-8377-778e59cc9d31 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:49.872723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed411a-ebd9-471e-8377-778e59cc9d31 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:49.872996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed411a-ebd9-471e-8377-778e59cc9d31 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:49.874339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 508/1003] 10.222.0.20 () {54 vars in 964 bytes} [Mon Oct 17 03:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:49.880270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0119-dbdf-483e-a385-fe503e5e6ed6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:49.880562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0119-dbdf-483e-a385-fe503e5e6ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:49.880868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0119-dbdf-483e-a385-fe503e5e6ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:49.911829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:49.957860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b27b0119-dbdf-483e-a385-fe503e5e6ed6 None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:49.959081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b27b0119-dbdf-483e-a385-fe503e5e6ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:50.035465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 496/1004] 10.222.0.20 () {58 vars in 1061 bytes} [Mon Oct 17 03:03:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:50.045095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed411a-ebd9-471e-8377-778e59cc9d31 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:50.046733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-09ed411a-ebd9-471e-8377-778e59cc9d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:50.151891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed411a-ebd9-471e-8377-778e59cc9d31 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:50.226283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:50.227151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:50.227432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:50.227697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:50.229295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:50.248520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:50.347849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:50.351252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b05ac-c695-4f38-b680-e2cfe299b09c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:50.369863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 509/1005] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:52.780591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e752106-c4c1-4c92-b9d2-3f31cfb7a518 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:52.781041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e752106-c4c1-4c92-b9d2-3f31cfb7a518 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:52.781130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e752106-c4c1-4c92-b9d2-3f31cfb7a518 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:52.782505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 497/1006] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:52.788856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80f53-ca1f-4cfa-bc05-f522ef16f336 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:52.789361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80f53-ca1f-4cfa-bc05-f522ef16f336 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:52.789546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc80f53-ca1f-4cfa-bc05-f522ef16f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:52.859089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0bc80f53-ca1f-4cfa-bc05-f522ef16f336 None None] MFA Rules not processed for user `756f4309353f49bda9534cdd99dbb397`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:52.860335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0bc80f53-ca1f-4cfa-bc05-f522ef16f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:52.924879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:52.961366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 510/1007] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:53.245386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e752106-c4c1-4c92-b9d2-3f31cfb7a518 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:53.246912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9e752106-c4c1-4c92-b9d2-3f31cfb7a518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:53.352806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e752106-c4c1-4c92-b9d2-3f31cfb7a518 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:53.373804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:53.426425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:53.427022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:53.427299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:53.427563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:53.429714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:53.538753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:53.540209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbf749-6434-46cc-9cc6-4a7917ca069e service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:53.558162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 498/1008] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:56.096946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13f65-d424-4684-b451-f787d3b4ecbd None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:56.097507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13f65-d424-4684-b451-f787d3b4ecbd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:56.097507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13f65-d424-4684-b451-f787d3b4ecbd None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:56.098861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 511/1009] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:56.104159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36208d-82d2-4d11-b878-5a47adb0d5f6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:56.104599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36208d-82d2-4d11-b878-5a47adb0d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:56.104700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36208d-82d2-4d11-b878-5a47adb0d5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:56.166527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:56.169201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bf36208d-82d2-4d11-b878-5a47adb0d5f6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:56.170887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bf36208d-82d2-4d11-b878-5a47adb0d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:56.264493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 499/1010] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:56.545192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13f65-d424-4684-b451-f787d3b4ecbd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:56.546726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05c13f65-d424-4684-b451-f787d3b4ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:56.648639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13f65-d424-4684-b451-f787d3b4ecbd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:56.720973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:56.721569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:56.721853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:56.722126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:56.723711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:56.750309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:56.831742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:56.833118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121fd3c-5383-4064-80d9-6ad9f14f440f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:56.851025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 512/1011] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:03:59.022464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802b152-9cb1-4e47-a046-2358e03fc8af None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:59.022989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802b152-9cb1-4e47-a046-2358e03fc8af None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:59.023103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802b152-9cb1-4e47-a046-2358e03fc8af None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:59.024420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 500/1012] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:03:59.029642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082793a3-20d8-41a7-a882-7c13a2657436 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:59.030032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082793a3-20d8-41a7-a882-7c13a2657436 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:59.030186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082793a3-20d8-41a7-a882-7c13a2657436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:59.094595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-082793a3-20d8-41a7-a882-7c13a2657436 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:03:59.095821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-082793a3-20d8-41a7-a882-7c13a2657436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:59.167736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:59.190277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 513/1013] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:03:59.478551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802b152-9cb1-4e47-a046-2358e03fc8af None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:03:59.480137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f802b152-9cb1-4e47-a046-2358e03fc8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:59.587485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802b152-9cb1-4e47-a046-2358e03fc8af None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:03:59.618695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:03:59.665806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:03:59.666412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:03:59.666693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:03:59.666967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:03:59.668588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:03:59.776345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:03:59.777775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da28720-1307-4896-89c4-52750ac8bf80 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:03:59.795723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 501/1014] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:02.386823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a980bc-6bf7-4d05-83f6-9dbf39d5ad7b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:02.387384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a980bc-6bf7-4d05-83f6-9dbf39d5ad7b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:02.387384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a980bc-6bf7-4d05-83f6-9dbf39d5ad7b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:02.388744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 514/1015] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:02.393728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1dd74-07e3-43c2-bd42-56a77402f427 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:02.394146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1dd74-07e3-43c2-bd42-56a77402f427 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:02.394283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1dd74-07e3-43c2-bd42-56a77402f427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:02.461048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-76b1dd74-07e3-43c2-bd42-56a77402f427 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:02.462246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-76b1dd74-07e3-43c2-bd42-56a77402f427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:02.470377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:02.557427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 502/1016] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:02.843181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a980bc-6bf7-4d05-83f6-9dbf39d5ad7b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:02.844749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39a980bc-6bf7-4d05-83f6-9dbf39d5ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:02.948569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a980bc-6bf7-4d05-83f6-9dbf39d5ad7b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:03.020975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:03.021577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:03.021856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:03.022129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:03.023712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:03.058690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:03.132741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:03.134173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2399b-a78d-403b-9a65-6db0954a2da6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:03.152366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 515/1017] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:07.301170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e80f-ecfe-468c-a7e2-d7de80b2d6de None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:07.301694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e80f-ecfe-468c-a7e2-d7de80b2d6de None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:07.301837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077e80f-ecfe-468c-a7e2-d7de80b2d6de None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:07.303095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 503/1018] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:07.308349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9b3a9-8a84-4640-bb1b-83666c495a17 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:07.308789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9b3a9-8a84-4640-bb1b-83666c495a17 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:07.309029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9b3a9-8a84-4640-bb1b-83666c495a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:07.374779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6ba9b3a9-8a84-4640-bb1b-83666c495a17 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:07.375900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6ba9b3a9-8a84-4640-bb1b-83666c495a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:07.460186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:07.471552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 516/1019] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:07.759007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e80f-ecfe-468c-a7e2-d7de80b2d6de None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:07.760680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c077e80f-ecfe-468c-a7e2-d7de80b2d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:07.865354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077e80f-ecfe-468c-a7e2-d7de80b2d6de None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:07.902236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:07.940531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:07.941134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:07.941414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:07.941687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:07.943304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:08.054968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:08.056357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb223b-978e-492f-a733-3c5a214ab359 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:08.074658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 504/1020] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:10.821114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0aad-dd21-4bf6-9cf0-942c2a8c46fe None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:10.821646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0aad-dd21-4bf6-9cf0-942c2a8c46fe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:10.821646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0aad-dd21-4bf6-9cf0-942c2a8c46fe None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:10.822982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 517/1021] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:10.828133 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871574a2-7180-4e93-b7e5-93df437d7d66 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:10.828560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871574a2-7180-4e93-b7e5-93df437d7d66 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:10.828677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871574a2-7180-4e93-b7e5-93df437d7d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:10.894375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-871574a2-7180-4e93-b7e5-93df437d7d66 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:10.895640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-871574a2-7180-4e93-b7e5-93df437d7d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:10.913917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:10.994511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 505/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:11.273961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b0aad-dd21-4bf6-9cf0-942c2a8c46fe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:11.275502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6c9b0aad-dd21-4bf6-9cf0-942c2a8c46fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:11.382173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b0aad-dd21-4bf6-9cf0-942c2a8c46fe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:11.461248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:11.461849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:11.462133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:11.462406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:11.464015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:11.507614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:11.574674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:11.576076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761222ef-a19a-41df-b0ec-4a21276ee0bb service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:11.594887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 518/1023] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:15.732128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a92f-58fc-4a9e-8efa-4be1486d558c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:15.732627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a92f-58fc-4a9e-8efa-4be1486d558c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:15.732714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a92f-58fc-4a9e-8efa-4be1486d558c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:15.734058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 506/1024] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:15.740033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8541-69cb-48fa-ad8a-7558a3b01fde None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:15.740439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8541-69cb-48fa-ad8a-7558a3b01fde None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:15.740606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8541-69cb-48fa-ad8a-7558a3b01fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:15.810728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-201d8541-69cb-48fa-ad8a-7558a3b01fde None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:15.812012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-201d8541-69cb-48fa-ad8a-7558a3b01fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:15.906046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:15.908411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 519/1025] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:16.195324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a92f-58fc-4a9e-8efa-4be1486d558c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:16.196885 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fea3a92f-58fc-4a9e-8efa-4be1486d558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:16.300392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a92f-58fc-4a9e-8efa-4be1486d558c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:16.347197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:16.373837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:16.374368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:16.374648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:16.374921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:16.376539 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:16.487891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:16.489864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d5799-51f0-4935-b612-f42c58231155 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:16.507781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 507/1026] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:21.438540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82a33-d8e1-47a5-8e90-021b1836f9eb None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:21.439028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82a33-d8e1-47a5-8e90-021b1836f9eb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:21.439130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82a33-d8e1-47a5-8e90-021b1836f9eb None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:21.444527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 520/1027] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:21.446376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03514955-c146-469b-a180-9e9fe534733c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:21.447173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03514955-c146-469b-a180-9e9fe534733c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:21.447704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03514955-c146-469b-a180-9e9fe534733c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:21.578903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-03514955-c146-469b-a180-9e9fe534733c None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:21.580518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-03514955-c146-469b-a180-9e9fe534733c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:21.602829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:21.745436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 508/1028] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:04:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:25.880155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec79f-3312-4bfc-a2eb-09d1d5712a1c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:25.881160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec79f-3312-4bfc-a2eb-09d1d5712a1c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:25.881665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec79f-3312-4bfc-a2eb-09d1d5712a1c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:25.883270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 521/1029] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:04:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:25.891692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f50af-86d4-4626-8242-239ed0322cb8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:25.891692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f50af-86d4-4626-8242-239ed0322cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:25.891692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f50af-86d4-4626-8242-239ed0322cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:25.975370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-160f50af-86d4-4626-8242-239ed0322cb8 None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:25.976630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-160f50af-86d4-4626-8242-239ed0322cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:26.051033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:26.090379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 509/1030] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:04:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:27.486240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ac89-21a8-458e-97d4-64ee95cbca6c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:27.486819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ac89-21a8-458e-97d4-64ee95cbca6c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:27.486819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ac89-21a8-458e-97d4-64ee95cbca6c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:27.488362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 522/1031] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:27.493388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be24aa-c923-4c87-bc03-c7924c01b578 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:27.493839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be24aa-c923-4c87-bc03-c7924c01b578 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:27.494064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be24aa-c923-4c87-bc03-c7924c01b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:27.570732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-13be24aa-c923-4c87-bc03-c7924c01b578 None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:27.571992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-13be24aa-c923-4c87-bc03-c7924c01b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:27.682645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 510/1032] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:04:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:31.214155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b29746-d44f-40a4-a140-1380e608f8e2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:31.214674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b29746-d44f-40a4-a140-1380e608f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:31.214674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b29746-d44f-40a4-a140-1380e608f8e2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:31.216229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 523/1033] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:31.221440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbfc84-dc70-4ae4-906e-a6f41754c960 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:31.222445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbfc84-dc70-4ae4-906e-a6f41754c960 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:31.222541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbfc84-dc70-4ae4-906e-a6f41754c960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:31.261974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:31.294700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-93dbfc84-dc70-4ae4-906e-a6f41754c960 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:31.295913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-93dbfc84-dc70-4ae4-906e-a6f41754c960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:31.395346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 511/1034] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:04:31.700617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58555f7c-7de4-425a-8565-576371e4e3b4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:31.700901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58555f7c-7de4-425a-8565-576371e4e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:31.701175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58555f7c-7de4-425a-8565-576371e4e3b4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:31.702509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 524/1035] 10.222.0.20 () {54 vars in 961 bytes} [Mon Oct 17 03:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:31.711830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff6b7-1456-414f-b0cc-c0538bbc4407 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:31.712233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff6b7-1456-414f-b0cc-c0538bbc4407 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:31.712580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ff6b7-1456-414f-b0cc-c0538bbc4407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:31.803525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cd1ff6b7-1456-414f-b0cc-c0538bbc4407 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:31.804804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cd1ff6b7-1456-414f-b0cc-c0538bbc4407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:31.857352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:31.928201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 512/1036] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Oct 17 03:04:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:31.936103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58555f7c-7de4-425a-8565-576371e4e3b4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:31.937618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-58555f7c-7de4-425a-8565-576371e4e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:32.102606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58555f7c-7de4-425a-8565-576371e4e3b4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:32.183473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:32.227756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:32.228416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:32.228647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:32.229185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:32.230972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:32.332668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:32.334404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c8c38e-9d06-4dfa-9977-4365941d3b97 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:32.354080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 525/1037] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:34.729585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8038a2b-5332-4236-8369-f10f9d9de692 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:34.730135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8038a2b-5332-4236-8369-f10f9d9de692 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:34.730135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8038a2b-5332-4236-8369-f10f9d9de692 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:34.731657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 513/1038] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:34.737005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e3f74-fc84-4119-a927-9118fa4782ad None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:34.737490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e3f74-fc84-4119-a927-9118fa4782ad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:34.737692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e3f74-fc84-4119-a927-9118fa4782ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:34.840757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-729e3f74-fc84-4119-a927-9118fa4782ad None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:34.842078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-729e3f74-fc84-4119-a927-9118fa4782ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:34.882355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:34.946217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 526/1039] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:35.238036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8038a2b-5332-4236-8369-f10f9d9de692 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:35.240163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a8038a2b-5332-4236-8369-f10f9d9de692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:35.426770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8038a2b-5332-4236-8369-f10f9d9de692 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:35.438311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:35.556210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:35.556820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:35.557106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:35.557382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:35.558986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:35.652865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:35.654447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f878c-bbca-449f-bca3-95284fcf10eb service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:35.674097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 514/1040] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:38.132148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b632f-eb90-43a2-b170-7f555162ba17 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:38.132724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b632f-eb90-43a2-b170-7f555162ba17 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:38.132724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b632f-eb90-43a2-b170-7f555162ba17 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:38.134037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 527/1041] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:38.139648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e9f7b-febe-47ad-9dd1-79a3d397508b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:38.140592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e9f7b-febe-47ad-9dd1-79a3d397508b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:38.141010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e9f7b-febe-47ad-9dd1-79a3d397508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:38.158863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:38.213684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-011e9f7b-febe-47ad-9dd1-79a3d397508b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:38.215051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-011e9f7b-febe-47ad-9dd1-79a3d397508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:38.317752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 515/1042] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:38.608502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374dcb2-504b-40e4-8817-b00388175cc5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:38.609181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374dcb2-504b-40e4-8817-b00388175cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:38.609574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374dcb2-504b-40e4-8817-b00388175cc5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:38.611036 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 528/1043] 10.222.0.20 () {54 vars in 961 bytes} [Mon Oct 17 03:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:38.616703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab692f51-fd98-4231-8a2a-832dab8a74a7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:38.617103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab692f51-fd98-4231-8a2a-832dab8a74a7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:38.617479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab692f51-fd98-4231-8a2a-832dab8a74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:38.705025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ab692f51-fd98-4231-8a2a-832dab8a74a7 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:38.707011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ab692f51-fd98-4231-8a2a-832dab8a74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:38.743440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:38.829327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 516/1044] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Oct 17 03:04:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:38.837955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374dcb2-504b-40e4-8817-b00388175cc5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:38.839601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6374dcb2-504b-40e4-8817-b00388175cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:38.999262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374dcb2-504b-40e4-8817-b00388175cc5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:39.021038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:39.120822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:39.121432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:39.121710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:39.121981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:39.123581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:39.220672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:39.222869 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95552bd-3694-4af4-9964-214ea205cc40 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:39.242032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 529/1045] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:39.433564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83ad65-af01-4fa1-ba8d-e167a681c335 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:39.434135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83ad65-af01-4fa1-ba8d-e167a681c335 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:39.434135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83ad65-af01-4fa1-ba8d-e167a681c335 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:39.435679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 517/1046] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:04:39.441883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d44b1-d14e-41d9-9cbf-5ec4e1779c50 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:39.442231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d44b1-d14e-41d9-9cbf-5ec4e1779c50 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:39.442439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d44b1-d14e-41d9-9cbf-5ec4e1779c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:39.477519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:39.517834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-871d44b1-d14e-41d9-9cbf-5ec4e1779c50 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:39.519273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-871d44b1-d14e-41d9-9cbf-5ec4e1779c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:39.637321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 530/1047] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:39.980757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ab03-c4b5-403c-b6c1-e8c1c3317d51 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:39.981287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ab03-c4b5-403c-b6c1-e8c1c3317d51 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:39.981565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9ab03-c4b5-403c-b6c1-e8c1c3317d51 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:39.983038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 518/1048] 10.222.0.20 () {54 vars in 963 bytes} [Mon Oct 17 03:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:39.988665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18325702-f354-4fa6-97f5-0ee7b9ae13aa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:39.989038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18325702-f354-4fa6-97f5-0ee7b9ae13aa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:39.989381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18325702-f354-4fa6-97f5-0ee7b9ae13aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:40.070067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-18325702-f354-4fa6-97f5-0ee7b9ae13aa None None] MFA Rules not processed for user `6eb1916e113843f6a02c8b80c33b1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:40.071459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-18325702-f354-4fa6-97f5-0ee7b9ae13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:40.120800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:40.155665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 531/1049] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Oct 17 03:04:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:40.163300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ab03-c4b5-403c-b6c1-e8c1c3317d51 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:40.164980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-86e9ab03-c4b5-403c-b6c1-e8c1c3317d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:40.276848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9ab03-c4b5-403c-b6c1-e8c1c3317d51 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:40.319962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:40.358341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:40.359484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:40.359772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:40.360085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:40.361791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:40.490754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:40.492135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d693f-e953-452f-93b3-e4197d01d0fc service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:40.523943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 519/1050] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:41.515968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc50ac-8874-4ea7-aac6-183bdb078116 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:41.516526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc50ac-8874-4ea7-aac6-183bdb078116 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:41.516526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc50ac-8874-4ea7-aac6-183bdb078116 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:41.517986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 532/1051] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:41.523232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca57a2-73b7-4a94-8cbc-5c5d0cc5e436 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:41.523643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca57a2-73b7-4a94-8cbc-5c5d0cc5e436 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:41.523795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca57a2-73b7-4a94-8cbc-5c5d0cc5e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:41.589876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7bca57a2-73b7-4a94-8cbc-5c5d0cc5e436 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:41.591272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7bca57a2-73b7-4a94-8cbc-5c5d0cc5e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:41.613901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:41.691885 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 520/1052] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:41.982037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc50ac-8874-4ea7-aac6-183bdb078116 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:41.983560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9afc50ac-8874-4ea7-aac6-183bdb078116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:42.143537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc50ac-8874-4ea7-aac6-183bdb078116 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:42.196402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:42.261403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:42.262009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:42.262283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:42.262553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:42.264235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:42.358126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:42.360042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ace5b-868e-447c-94e0-48a700d438cd service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:42.379605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 533/1053] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:44.612913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742c5b-683b-4928-8ba0-a9acfd12a4be None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:44.613411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742c5b-683b-4928-8ba0-a9acfd12a4be None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:44.613411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f742c5b-683b-4928-8ba0-a9acfd12a4be None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:44.614855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 521/1054] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:44.619917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe07c2-9640-49f8-95d6-e7ab1833f240 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:44.620321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe07c2-9640-49f8-95d6-e7ab1833f240 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:44.620493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe07c2-9640-49f8-95d6-e7ab1833f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:44.690520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dcfe07c2-9640-49f8-95d6-e7ab1833f240 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:44.691718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dcfe07c2-9640-49f8-95d6-e7ab1833f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:44.699214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:44.798528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 534/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:45.089046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742c5b-683b-4928-8ba0-a9acfd12a4be None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:45.090549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5f742c5b-683b-4928-8ba0-a9acfd12a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:45.245320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f742c5b-683b-4928-8ba0-a9acfd12a4be None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:45.249255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:45.365173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:45.365779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:45.366061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:45.366339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:45.368026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:45.464394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:45.465967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2c47c-aed3-4615-be1c-73a0bfc263a0 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:45.485177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 522/1056] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:47.711927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7638e76-8a9f-432b-83b3-7d2f09f1b1b9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:47.712402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7638e76-8a9f-432b-83b3-7d2f09f1b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:47.712485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7638e76-8a9f-432b-83b3-7d2f09f1b1b9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:47.714053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 535/1057] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:47.719244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98cbaa-2f2c-4c8a-b150-56f5217cf28b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:47.719684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98cbaa-2f2c-4c8a-b150-56f5217cf28b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:47.720024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98cbaa-2f2c-4c8a-b150-56f5217cf28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:47.733159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:47.794345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1c98cbaa-2f2c-4c8a-b150-56f5217cf28b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:47.795741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1c98cbaa-2f2c-4c8a-b150-56f5217cf28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:47.923290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 523/1058] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:48.266402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7638e76-8a9f-432b-83b3-7d2f09f1b1b9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:48.268477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7638e76-8a9f-432b-83b3-7d2f09f1b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:48.414184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:48.425129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7638e76-8a9f-432b-83b3-7d2f09f1b1b9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:48.540272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:48.540798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:48.541079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:48.541348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:48.542946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:48.635892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:48.637497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8274a-d3e1-4af6-8a59-f710397abbb9 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:48.647492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:48.656641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 536/1059] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:50.838532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af691-44ee-42e7-ad99-ad0ea8a1ff46 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:50.839141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af691-44ee-42e7-ad99-ad0ea8a1ff46 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:50.839141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88af691-44ee-42e7-ad99-ad0ea8a1ff46 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:50.840682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 524/1060] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:50.845877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bac7-a5bb-49fc-9a3a-a702944e242f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:50.846706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bac7-a5bb-49fc-9a3a-a702944e242f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:50.846706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95bac7-a5bb-49fc-9a3a-a702944e242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:50.919453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7c95bac7-a5bb-49fc-9a3a-a702944e242f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:50.920687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7c95bac7-a5bb-49fc-9a3a-a702944e242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:51.024957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 537/1061] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:51.313120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af691-44ee-42e7-ad99-ad0ea8a1ff46 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:51.316016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a88af691-44ee-42e7-ad99-ad0ea8a1ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:51.421686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:51.505608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88af691-44ee-42e7-ad99-ad0ea8a1ff46 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:51.622254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:51.622766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:51.623046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:51.623319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:51.624965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:51.686051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:51.725831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:51.727407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727606-b1d5-4316-bb98-03418fa5ab60 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:51.752344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 525/1062] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:53.914296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000452aa-ab0e-433a-9fee-78e47ab01aec None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:53.915070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000452aa-ab0e-433a-9fee-78e47ab01aec None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:53.915070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000452aa-ab0e-433a-9fee-78e47ab01aec None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:53.916361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 538/1063] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:53.921612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6ed3f-516c-4847-bd4d-fb848011618b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:53.922125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6ed3f-516c-4847-bd4d-fb848011618b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:53.922125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6ed3f-516c-4847-bd4d-fb848011618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:53.993407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-daf6ed3f-516c-4847-bd4d-fb848011618b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:53.994602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-daf6ed3f-516c-4847-bd4d-fb848011618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:54.094815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 526/1064] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:54.386301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000452aa-ab0e-433a-9fee-78e47ab01aec None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:54.387835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-000452aa-ab0e-433a-9fee-78e47ab01aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:54.464106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:54.535002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000452aa-ab0e-433a-9fee-78e47ab01aec None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:54.648246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:54.648768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:54.649052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:54.649327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:54.650920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:54.690234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:54.742323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:54.743939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea85ad-91c5-45bc-bad5-6854003761e5 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:54.762494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 539/1065] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:56.042214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1d3f-f568-424d-9f0d-6222b34a8613 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.042705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1d3f-f568-424d-9f0d-6222b34a8613 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.042801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1d3f-f568-424d-9f0d-6222b34a8613 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:56.044165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 527/1066] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:56.049908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dba20-c242-4d3f-ac88-81a5ec303df5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.050329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dba20-c242-4d3f-ac88-81a5ec303df5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.050454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dba20-c242-4d3f-ac88-81a5ec303df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:56.116222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b98dba20-c242-4d3f-ac88-81a5ec303df5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:56.117401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b98dba20-c242-4d3f-ac88-81a5ec303df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:56.228702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 540/1067] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:56.542650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6526325-4ff8-418d-998a-e1803ccfba8b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.542937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6526325-4ff8-418d-998a-e1803ccfba8b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.543215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6526325-4ff8-418d-998a-e1803ccfba8b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:56.544589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 528/1068] 10.222.0.20 () {54 vars in 962 bytes} [Mon Oct 17 03:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:56.550053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb45b-fdf8-4b43-b88a-2f486e14e159 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.550408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb45b-fdf8-4b43-b88a-2f486e14e159 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.550774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cb45b-fdf8-4b43-b88a-2f486e14e159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:56.569512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:56.631246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fb8cb45b-fdf8-4b43-b88a-2f486e14e159 None None] MFA Rules not processed for user `b4351f9211b24b91b2521d717905dbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:56.632513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb8cb45b-fdf8-4b43-b88a-2f486e14e159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:56.709970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 541/1069] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Oct 17 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:04:56.719323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6526325-4ff8-418d-998a-e1803ccfba8b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:56.720944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d6526325-4ff8-418d-998a-e1803ccfba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:56.753293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:56.835432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6526325-4ff8-418d-998a-e1803ccfba8b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:56.948428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:56.949241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.949374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.949585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:56.950715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a849e-cdc0-47da-aa1e-6be33809cdee None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.951013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a849e-cdc0-47da-aa1e-6be33809cdee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.951231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:56.951363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a849e-cdc0-47da-aa1e-6be33809cdee None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:56.952738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 542/1070] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:56.958156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8426-1d99-4bc5-95f9-702efc6b4811 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:56.958442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8426-1d99-4bc5-95f9-702efc6b4811 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:56.958726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8426-1d99-4bc5-95f9-702efc6b4811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:57.027617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f38a8426-1d99-4bc5-95f9-702efc6b4811 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:57.028866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f38a8426-1d99-4bc5-95f9-702efc6b4811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:57.033925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:57.068580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:57.070011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:57.084588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:57.088955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 529/1071] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:57.128345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 543/1072] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:04:57.425519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:57.426735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:57.552387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932d3a-d053-4f25-95c2-498c4feab3a3 service glance] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:57.636659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:57.676076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:57.676610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:57.676893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:57.677168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:57.678870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:57.778312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:57.779910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c409-c342-4258-b9e5-45bac6a36f76 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:57.800412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 530/1073] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:04:57.847330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aae92f-49fd-4b2c-bad0-47131d915661 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:57.847625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aae92f-49fd-4b2c-bad0-47131d915661 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:57.847928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aae92f-49fd-4b2c-bad0-47131d915661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:57.924046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-23aae92f-49fd-4b2c-bad0-47131d915661 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:57.925297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23aae92f-49fd-4b2c-bad0-47131d915661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:58.028787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 544/1074] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:04:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:04:58.073250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3a9d-ab5b-4826-b0d9-ceaf8b49eff4 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:58.073762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3a9d-ab5b-4826-b0d9-ceaf8b49eff4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:58.073867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83b3a9d-ab5b-4826-b0d9-ceaf8b49eff4 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:58.075152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 531/1075] 10.222.0.20 () {54 vars in 943 bytes} [Mon Oct 17 03:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:04:58.081651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4dc3-7810-42da-a952-a0842fdd4263 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:58.081972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4dc3-7810-42da-a952-a0842fdd4263 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:58.082443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4dc3-7810-42da-a952-a0842fdd4263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:58.143449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:58.162607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3e2b4dc3-7810-42da-a952-a0842fdd4263 None None] MFA Rules not processed for user `eb1d31c2fdfe467ebbed5a3a46ab4325`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:04:58.163819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e2b4dc3-7810-42da-a952-a0842fdd4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:58.272667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 545/1076] 10.222.0.20 () {58 vars in 1040 bytes} [Mon Oct 17 03:04:58 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:04:58.282023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3a9d-ab5b-4826-b0d9-ceaf8b49eff4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:04:58.284094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b83b3a9d-ab5b-4826-b0d9-ceaf8b49eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:58.375949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:58.424956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83b3a9d-ab5b-4826-b0d9-ceaf8b49eff4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:04:58.530315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:04:58.530862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:04:58.531144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:04:58.531418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:04:58.533684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:04:58.611271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:04:58.621179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:04:58.622795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ef676-f648-493a-9433-19c316b28d40 service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:04:58.631142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 532/1077] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:04:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:05:00.048525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc050f-7f07-4e9d-b5a3-b38830631be9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:00.049041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc050f-7f07-4e9d-b5a3-b38830631be9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:00.049124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc050f-7f07-4e9d-b5a3-b38830631be9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:00.051547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 546/1078] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:00.056002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e97982-a037-4a34-a527-1e1fe8964986 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:00.056443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e97982-a037-4a34-a527-1e1fe8964986 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:00.056589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e97982-a037-4a34-a527-1e1fe8964986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:00.129101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-28e97982-a037-4a34-a527-1e1fe8964986 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:00.130482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-28e97982-a037-4a34-a527-1e1fe8964986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:00.248993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 533/1079] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:00.541306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc050f-7f07-4e9d-b5a3-b38830631be9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:00.542908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-17fc050f-7f07-4e9d-b5a3-b38830631be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:00.669070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:00.719051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc050f-7f07-4e9d-b5a3-b38830631be9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:00.858457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14187b79-238a-49e3-9184-da285e129312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:00.858988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14187b79-238a-49e3-9184-da285e129312 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:00.859265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14187b79-238a-49e3-9184-da285e129312 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:00.859533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14187b79-238a-49e3-9184-da285e129312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:00.861204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-14187b79-238a-49e3-9184-da285e129312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:00.949521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:00.975796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14187b79-238a-49e3-9184-da285e129312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:00.977438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14187b79-238a-49e3-9184-da285e129312 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:00.999140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 547/1080] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:03.242341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82af8-59d9-42bc-a77f-77c92f497375 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:03.242865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82af8-59d9-42bc-a77f-77c92f497375 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:03.242990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82af8-59d9-42bc-a77f-77c92f497375 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:03.244310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 534/1081] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:03.251396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab426-3c23-4a75-8c69-9be7ae1278b7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:03.251909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab426-3c23-4a75-8c69-9be7ae1278b7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:03.252060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab426-3c23-4a75-8c69-9be7ae1278b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:03.324673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-675ab426-3c23-4a75-8c69-9be7ae1278b7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:03.325793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-675ab426-3c23-4a75-8c69-9be7ae1278b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:03.431344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 548/1082] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:03.719066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c82af8-59d9-42bc-a77f-77c92f497375 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:03.722549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9c82af8-59d9-42bc-a77f-77c92f497375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:03.803221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:03.888788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c82af8-59d9-42bc-a77f-77c92f497375 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:04.021768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:04.022444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:04.022733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:04.022990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:04.024720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:04.063649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:04.126684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:04.128312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5cb2a-9e98-4cd5-9812-4e64cfe8a22a service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:04.149065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 535/1083] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:06.357728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7737-a495-4169-9518-0ed1f829fc31 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:06.358560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7737-a495-4169-9518-0ed1f829fc31 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:06.358560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc7737-a495-4169-9518-0ed1f829fc31 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:06.359954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 549/1084] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:06.365687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5352-9506-49e7-96de-0a50c9921d5a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:06.366128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5352-9506-49e7-96de-0a50c9921d5a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:06.366305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5352-9506-49e7-96de-0a50c9921d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:06.439420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e0ac5352-9506-49e7-96de-0a50c9921d5a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:06.440678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e0ac5352-9506-49e7-96de-0a50c9921d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:06.550973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 536/1085] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:06.841568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc7737-a495-4169-9518-0ed1f829fc31 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:06.843091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-67dc7737-a495-4169-9518-0ed1f829fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:06.908306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:07.023500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc7737-a495-4169-9518-0ed1f829fc31 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:07.174836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:07.175377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:07.175671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:07.175963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:07.177727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:07.203686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:07.318518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:07.320711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318707c0-f604-4558-9e75-16679fc516ee service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:07.341083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 550/1086] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:16.549287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:17.338412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=41 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:21.629109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215977f6-cc74-428a-9f63-0b66bd64c893 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:21.629692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215977f6-cc74-428a-9f63-0b66bd64c893 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:21.629692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215977f6-cc74-428a-9f63-0b66bd64c893 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:21.631153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 537/1087] 10.222.0.20 () {54 vars in 918 bytes} [Mon Oct 17 03:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:21.636325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109062f4-3d2d-4944-8542-7612392119b0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:21.636708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109062f4-3d2d-4944-8542-7612392119b0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:21.636873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109062f4-3d2d-4944-8542-7612392119b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:21.712423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-109062f4-3d2d-4944-8542-7612392119b0 None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:21.713627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-109062f4-3d2d-4944-8542-7612392119b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:21.817377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 551/1088] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Oct 17 03:05:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:05:21.831349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba7a72-54ca-43e2-84d7-9f6101619241 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:21.831638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba7a72-54ca-43e2-84d7-9f6101619241 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:21.831934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba7a72-54ca-43e2-84d7-9f6101619241 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:21.833336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 538/1089] 10.222.0.20 () {54 vars in 918 bytes} [Mon Oct 17 03:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:21.837901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03082f-554d-4a70-b802-38aa3eb6a531 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:21.838190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03082f-554d-4a70-b802-38aa3eb6a531 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:21.838463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03082f-554d-4a70-b802-38aa3eb6a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:21.911315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:21.913912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5f03082f-554d-4a70-b802-38aa3eb6a531 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:21.915685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5f03082f-554d-4a70-b802-38aa3eb6a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:22.032580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 552/1090] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Oct 17 03:05:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:24.573839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55263-a843-4b74-9561-1d6d7da76402 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:24.574373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55263-a843-4b74-9561-1d6d7da76402 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:24.574373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f55263-a843-4b74-9561-1d6d7da76402 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:24.575707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 539/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:24.581103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161682f2-4d94-41ee-bcdc-8c9ce0857d22 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:24.581527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161682f2-4d94-41ee-bcdc-8c9ce0857d22 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:24.581655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161682f2-4d94-41ee-bcdc-8c9ce0857d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:24.647631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-161682f2-4d94-41ee-bcdc-8c9ce0857d22 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:24.648867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-161682f2-4d94-41ee-bcdc-8c9ce0857d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:24.703142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:24.744096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 553/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:25.033917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f55263-a843-4b74-9561-1d6d7da76402 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:25.035529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e8f55263-a843-4b74-9561-1d6d7da76402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:25.180755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f55263-a843-4b74-9561-1d6d7da76402 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:25.253089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:25.293643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:25.294246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:25.294522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:25.294793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:25.297332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:25.384311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:25.385879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb971235-df59-429b-86a4-63a7aba40c3c service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:25.403859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 540/1093] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:26.532816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c130-c2e6-4b4d-97b8-33ec0430a8fe None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:26.533356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c130-c2e6-4b4d-97b8-33ec0430a8fe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:26.533356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8c130-c2e6-4b4d-97b8-33ec0430a8fe None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:26.534720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 554/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:26.540763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf28816-eec1-49df-a407-8816ef21feb7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:26.541200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf28816-eec1-49df-a407-8816ef21feb7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:26.541470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf28816-eec1-49df-a407-8816ef21feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:26.616402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ccf28816-eec1-49df-a407-8816ef21feb7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:26.617592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ccf28816-eec1-49df-a407-8816ef21feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:26.644198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:26.712021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 541/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:26.862405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8c130-c2e6-4b4d-97b8-33ec0430a8fe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:26.863846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-32a8c130-c2e6-4b4d-97b8-33ec0430a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:27.007114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8c130-c2e6-4b4d-97b8-33ec0430a8fe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:27.050547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:27.128523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:27.129044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:27.129318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:27.129583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:27.131151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:27.216460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:27.218099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb2f6f-a49e-4af5-ad2f-d7ac83509230 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:27.236355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 555/1096] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:28.361047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fb09b-3449-4a4f-9546-bee2dc412b63 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:28.361643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fb09b-3449-4a4f-9546-bee2dc412b63 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:28.361643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2fb09b-3449-4a4f-9546-bee2dc412b63 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:28.362940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 542/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:28.369078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502aa96-2179-4bed-b635-7cf5d07d03f3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:28.369535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502aa96-2179-4bed-b635-7cf5d07d03f3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:28.369642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502aa96-2179-4bed-b635-7cf5d07d03f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:28.423620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:28.445534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2502aa96-2179-4bed-b635-7cf5d07d03f3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:28.446716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2502aa96-2179-4bed-b635-7cf5d07d03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:28.541890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 556/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:28.693365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fb09b-3449-4a4f-9546-bee2dc412b63 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:28.694871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9c2fb09b-3449-4a4f-9546-bee2dc412b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:28.836217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2fb09b-3449-4a4f-9546-bee2dc412b63 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:28.848430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:28.948233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:28.948760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:28.949060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:28.949331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:28.950937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:29.039865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:29.041527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4989-5c4e-4926-a7f6-bc218c121087 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:29.059784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 543/1099] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:30.166286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9442-b647-4c48-aa67-6ac7f423738e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:30.166839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9442-b647-4c48-aa67-6ac7f423738e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:30.166839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f9442-b647-4c48-aa67-6ac7f423738e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:30.168207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 557/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:05:30.174878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746efc19-cbad-4cfa-96c6-fd5578f7d53b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:30.175323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746efc19-cbad-4cfa-96c6-fd5578f7d53b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:30.175445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746efc19-cbad-4cfa-96c6-fd5578f7d53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:30.194992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:30.251160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-746efc19-cbad-4cfa-96c6-fd5578f7d53b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:30.252416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-746efc19-cbad-4cfa-96c6-fd5578f7d53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:30.346686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 544/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:30.496711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f9442-b647-4c48-aa67-6ac7f423738e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:30.498205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ef3f9442-b647-4c48-aa67-6ac7f423738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:30.608954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:30.644786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f9442-b647-4c48-aa67-6ac7f423738e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:30.755152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:30.755753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:30.756055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:30.756325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:30.757879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:30.831071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:30.844779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:30.846360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4c568-0905-4303-9c1f-193f4d2166e6 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:30.864714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 558/1102] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:31.966222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd1cf-bd6e-4af0-a88d-e9edcb711d12 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:31.966668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd1cf-bd6e-4af0-a88d-e9edcb711d12 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:31.966779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fd1cf-bd6e-4af0-a88d-e9edcb711d12 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:31.968734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 545/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:31.975206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed3f9-5203-4c12-a3fa-0ba617c2f40f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:31.975638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed3f9-5203-4c12-a3fa-0ba617c2f40f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:31.975792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed3f9-5203-4c12-a3fa-0ba617c2f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:32.052394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fe5ed3f9-5203-4c12-a3fa-0ba617c2f40f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:32.053609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fe5ed3f9-5203-4c12-a3fa-0ba617c2f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:32.148274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 559/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:32.296842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fd1cf-bd6e-4af0-a88d-e9edcb711d12 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:32.298356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-632fd1cf-bd6e-4af0-a88d-e9edcb711d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:32.380870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:32.440989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fd1cf-bd6e-4af0-a88d-e9edcb711d12 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:32.552261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:32.552796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:32.553074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:32.553344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:32.554922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:32.601742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:32.643339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:32.644946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d2b0e-4ef2-4a7e-9896-55c27891f168 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:32.662928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 546/1105] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:33.708238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221397-6b46-4ee4-a74a-9a8f1cdab5b4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:33.708780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221397-6b46-4ee4-a74a-9a8f1cdab5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:33.708780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85221397-6b46-4ee4-a74a-9a8f1cdab5b4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:33.710211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 560/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:33.716274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7251ce1-3637-440b-a54a-6322d58a5fac None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:33.716725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7251ce1-3637-440b-a54a-6322d58a5fac None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:33.716819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7251ce1-3637-440b-a54a-6322d58a5fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:33.792425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e7251ce1-3637-440b-a54a-6322d58a5fac None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:33.793635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e7251ce1-3637-440b-a54a-6322d58a5fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:33.890077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 547/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:34.040150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221397-6b46-4ee4-a74a-9a8f1cdab5b4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:34.041664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85221397-6b46-4ee4-a74a-9a8f1cdab5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:34.098827 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:34.194381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85221397-6b46-4ee4-a74a-9a8f1cdab5b4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:34.308194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:34.308840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:34.309121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:34.309402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:34.311508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:34.319665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:34.404279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:34.405897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad94f8-f0e1-4938-bb2b-5fda0744c1a4 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:34.424298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 561/1108] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:35.472302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae59343-8891-4402-b6a7-7e2ec0d9ebe1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:35.472865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae59343-8891-4402-b6a7-7e2ec0d9ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:35.472865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae59343-8891-4402-b6a7-7e2ec0d9ebe1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:35.474203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 548/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:35.480814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57c97-e35f-49c0-b3d6-9712177c4b00 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:35.481270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57c97-e35f-49c0-b3d6-9712177c4b00 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:35.481493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57c97-e35f-49c0-b3d6-9712177c4b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:35.558330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-30f57c97-e35f-49c0-b3d6-9712177c4b00 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:35.559546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30f57c97-e35f-49c0-b3d6-9712177c4b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:35.628741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:35.657426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 562/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:35.806415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae59343-8891-4402-b6a7-7e2ec0d9ebe1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:35.807950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fae59343-8891-4402-b6a7-7e2ec0d9ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:35.825554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:35.952695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae59343-8891-4402-b6a7-7e2ec0d9ebe1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:36.038912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:36.065753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:36.066350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:36.066635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:36.066910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:36.068542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:36.155844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:36.157438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872eb93-09c9-4633-bdc8-fdc0e07675f4 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:36.175634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 549/1111] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:37.227840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39780ba-3c19-4a1e-bc90-63d521971bf8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:37.228431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39780ba-3c19-4a1e-bc90-63d521971bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:37.228431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39780ba-3c19-4a1e-bc90-63d521971bf8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:37.229697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 563/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:37.236177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a96996-fb0f-4016-a402-b1cbfeb3f70f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:37.236634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a96996-fb0f-4016-a402-b1cbfeb3f70f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:37.236755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a96996-fb0f-4016-a402-b1cbfeb3f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:37.311611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-29a96996-fb0f-4016-a402-b1cbfeb3f70f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:37.312850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-29a96996-fb0f-4016-a402-b1cbfeb3f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:37.353467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:37.408272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 550/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:37.557366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39780ba-3c19-4a1e-bc90-63d521971bf8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:37.558880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c39780ba-3c19-4a1e-bc90-63d521971bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:37.702846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39780ba-3c19-4a1e-bc90-63d521971bf8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:37.756243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:37.815490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:37.816169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:37.816450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:37.816721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:37.818367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:37.906629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:37.908247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169113a6-9e19-4d27-a5e1-241aed403396 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:37.926391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 564/1114] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:38.980260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf849-ad68-4104-99d3-400be5e194b1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:38.980734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf849-ad68-4104-99d3-400be5e194b1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:38.980840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf849-ad68-4104-99d3-400be5e194b1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:38.983013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 551/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:38.989209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6e32-c1a4-4c06-8341-6d80320ee042 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:38.989636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6e32-c1a4-4c06-8341-6d80320ee042 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:38.989747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e6e32-c1a4-4c06-8341-6d80320ee042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:39.065041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6a3e6e32-c1a4-4c06-8341-6d80320ee042 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:39.066224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6a3e6e32-c1a4-4c06-8341-6d80320ee042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:39.068207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:39.159600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 565/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:39.307295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf849-ad68-4104-99d3-400be5e194b1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:39.308841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-04bcf849-ad68-4104-99d3-400be5e194b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:39.452128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf849-ad68-4104-99d3-400be5e194b1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:39.479031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:39.563517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:39.564063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:39.564346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:39.564622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:39.566216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:39.653181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:39.654785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153277d-ff86-41ea-be1d-ba60c4efb7b8 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:39.673477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 552/1117] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:41.725730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45dde-3072-47e4-984f-a219ba373122 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:41.726260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45dde-3072-47e4-984f-a219ba373122 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:41.726260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d45dde-3072-47e4-984f-a219ba373122 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:41.727632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 566/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:41.733280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be9de-d851-4b66-b87c-b3b4a007a514 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:41.733705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be9de-d851-4b66-b87c-b3b4a007a514 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:41.733831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be9de-d851-4b66-b87c-b3b4a007a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:41.774346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:41.799387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cb7be9de-d851-4b66-b87c-b3b4a007a514 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:41.800613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cb7be9de-d851-4b66-b87c-b3b4a007a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:41.896306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 553/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:42.181361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45dde-3072-47e4-984f-a219ba373122 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:42.182893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-70d45dde-3072-47e4-984f-a219ba373122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:42.285521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d45dde-3072-47e4-984f-a219ba373122 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:42.318528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:42.361632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:42.362233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:42.362510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:42.362780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:42.364391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:42.470542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:42.471897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86baa8-b085-480a-aecd-bd86e5f44ceb service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:42.490536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 567/1120] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:44.773063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5c45-c7c8-49c0-a270-5d3ae3f71cdc None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:44.773603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5c45-c7c8-49c0-a270-5d3ae3f71cdc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:44.773603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5c45-c7c8-49c0-a270-5d3ae3f71cdc None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:44.774960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 554/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:44.780761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb042f7-bedc-40cc-8e1c-ffb3841578c3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:44.781212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb042f7-bedc-40cc-8e1c-ffb3841578c3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:44.781311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb042f7-bedc-40cc-8e1c-ffb3841578c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:44.845677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5eb042f7-bedc-40cc-8e1c-ffb3841578c3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:44.846857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5eb042f7-bedc-40cc-8e1c-ffb3841578c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:44.859507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:44.941461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 568/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:45.222424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5c45-c7c8-49c0-a270-5d3ae3f71cdc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:45.224002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7a5b5c45-c7c8-49c0-a270-5d3ae3f71cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:45.325163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5c45-c7c8-49c0-a270-5d3ae3f71cdc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:45.338237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:45.399184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:45.399785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:45.400098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:45.400375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:45.401967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:45.508673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:45.510085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a540d77-46b0-4d05-8330-4bc6b7361326 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:45.527996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 555/1123] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:47.962442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcfeaf-7480-4375-8577-ff8147749a45 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:47.962819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcfeaf-7480-4375-8577-ff8147749a45 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:47.962996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcfeaf-7480-4375-8577-ff8147749a45 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:47.964398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 569/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:47.970466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5575f-e345-4fe6-9782-cc65eeef3122 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:47.970859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5575f-e345-4fe6-9782-cc65eeef3122 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:47.971014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5575f-e345-4fe6-9782-cc65eeef3122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:48.018270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:48.036442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ffd5575f-e345-4fe6-9782-cc65eeef3122 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:48.037647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ffd5575f-e345-4fe6-9782-cc65eeef3122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:48.132737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 556/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:48.418301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcfeaf-7480-4375-8577-ff8147749a45 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:48.420549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5bfcfeaf-7480-4375-8577-ff8147749a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:48.522950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcfeaf-7480-4375-8577-ff8147749a45 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:48.563666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:48.597921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:48.598528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:48.598806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:48.599078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:48.600712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:48.707059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:48.708455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fd155-51ae-4ecf-980c-dd4d5dfd2213 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:48.725933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 570/1126] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:50.984656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d523-85d2-4efa-b548-7f8d81d49a57 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:50.985092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d523-85d2-4efa-b548-7f8d81d49a57 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:50.985213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0d523-85d2-4efa-b548-7f8d81d49a57 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:50.986667 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 557/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:50.992164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57f9e9-8627-4ef9-ad6c-c624c7e7b529 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:50.992592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57f9e9-8627-4ef9-ad6c-c624c7e7b529 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:50.992716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57f9e9-8627-4ef9-ad6c-c624c7e7b529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:51.057435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3f57f9e9-8627-4ef9-ad6c-c624c7e7b529 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:51.058620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f57f9e9-8627-4ef9-ad6c-c624c7e7b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:51.079519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:51.154892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 571/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:51.440276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0d523-85d2-4efa-b548-7f8d81d49a57 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:51.441798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-17f0d523-85d2-4efa-b548-7f8d81d49a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:51.541733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0d523-85d2-4efa-b548-7f8d81d49a57 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:51.562197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:51.616471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:51.617070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:51.617347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:51.617616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:51.619192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:51.728379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:51.729756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42921bf8-db04-4887-ac21-7345e1cf5ecd service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:51.748583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 558/1129] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:05:53.920690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b319-fcac-4c39-ac1f-071aeafe794b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:53.921284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b319-fcac-4c39-ac1f-071aeafe794b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:53.921284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806b319-fcac-4c39-ac1f-071aeafe794b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:53.922558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 572/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:53.927720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc981dd-2542-44bb-bd45-53c2a093a35e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:53.928136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc981dd-2542-44bb-bd45-53c2a093a35e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:53.928310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc981dd-2542-44bb-bd45-53c2a093a35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:53.991227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:53.993932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fbc981dd-2542-44bb-bd45-53c2a093a35e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:53.995758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fbc981dd-2542-44bb-bd45-53c2a093a35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:54.090936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 559/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:54.376001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806b319-fcac-4c39-ac1f-071aeafe794b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:54.377540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e806b319-fcac-4c39-ac1f-071aeafe794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:54.478576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806b319-fcac-4c39-ac1f-071aeafe794b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:54.528928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:54.553290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:54.553885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:54.554162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:54.554432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:54.556036 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:54.662232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:54.663582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2ef8f-6129-4c05-8928-37dd09383156 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:54.682225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 573/1132] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:56.874328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdf6d1-db16-48fc-b9bd-e88dfd8fa636 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:56.874864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdf6d1-db16-48fc-b9bd-e88dfd8fa636 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:56.874864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcdf6d1-db16-48fc-b9bd-e88dfd8fa636 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:56.876239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 560/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:56.881569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651eaac-9bf3-4c35-b76d-42769a366da3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:56.881944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651eaac-9bf3-4c35-b76d-42769a366da3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:56.882114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651eaac-9bf3-4c35-b76d-42769a366da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:56.947352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8651eaac-9bf3-4c35-b76d-42769a366da3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:56.948592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8651eaac-9bf3-4c35-b76d-42769a366da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:56.977306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:57.044393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 574/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:05:57.326313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdf6d1-db16-48fc-b9bd-e88dfd8fa636 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:05:57.327830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-adcdf6d1-db16-48fc-b9bd-e88dfd8fa636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:57.430225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcdf6d1-db16-48fc-b9bd-e88dfd8fa636 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:05:57.459273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:57.504818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:05:57.505421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:57.505697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:57.505965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:57.507567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:57.614419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:05:57.615759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00586864-d770-46d5-901c-1da5135f3a27 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:05:57.634226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 561/1135] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:05:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:05:59.818952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3847-6cf3-457e-a485-9c2f841c0e81 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:59.819575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3847-6cf3-457e-a485-9c2f841c0e81 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:59.819575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b3847-6cf3-457e-a485-9c2f841c0e81 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:59.820925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 575/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:05:59.827114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046e17-b615-4aa0-b582-e04731e025e5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:05:59.827566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046e17-b615-4aa0-b582-e04731e025e5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:05:59.827676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5046e17-b615-4aa0-b582-e04731e025e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:05:59.891866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c5046e17-b615-4aa0-b582-e04731e025e5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:05:59.893080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c5046e17-b615-4aa0-b582-e04731e025e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:05:59.901339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:05:59.990455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 562/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:00.270570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b3847-6cf3-457e-a485-9c2f841c0e81 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:00.272232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a6b3847-6cf3-457e-a485-9c2f841c0e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:00.377598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b3847-6cf3-457e-a485-9c2f841c0e81 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:00.433230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:00.452029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:00.452638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:00.452914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:00.453187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:00.454763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:00.562470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:00.563837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e532a-01fa-4aac-bd94-d4e223679a7b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:00.582095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 576/1138] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:02.757116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5a74-aedf-4cf0-9b52-a7184cbf1e46 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:02.757739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5a74-aedf-4cf0-9b52-a7184cbf1e46 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:02.757739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d5a74-aedf-4cf0-9b52-a7184cbf1e46 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:02.758991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 563/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:02.764374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc91e7-7e18-47c2-843d-7e393a46d683 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:02.764795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc91e7-7e18-47c2-843d-7e393a46d683 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:02.764930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc91e7-7e18-47c2-843d-7e393a46d683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:02.830577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a8dc91e7-7e18-47c2-843d-7e393a46d683 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:02.831773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a8dc91e7-7e18-47c2-843d-7e393a46d683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:02.869772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:02.926859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 577/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:03.213558 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d5a74-aedf-4cf0-9b52-a7184cbf1e46 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:03.215689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-697d5a74-aedf-4cf0-9b52-a7184cbf1e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:03.317387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d5a74-aedf-4cf0-9b52-a7184cbf1e46 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:03.354672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:03.390772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:03.391372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:03.391645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:03.391938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:03.393504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:03.500856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:03.502274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2187-3197-438e-909a-65199f36e6cb service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:03.519779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 564/1141] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:05.661759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf1f8-09ae-4e56-8a9a-f84c5e63734c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:05.662322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf1f8-09ae-4e56-8a9a-f84c5e63734c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:05.662322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bf1f8-09ae-4e56-8a9a-f84c5e63734c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:05.663667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 578/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:05.669112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9449-2a63-4dcb-88e3-6c0125914757 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:05.669534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9449-2a63-4dcb-88e3-6c0125914757 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:05.669645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9449-2a63-4dcb-88e3-6c0125914757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:05.735919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ae9d9449-2a63-4dcb-88e3-6c0125914757 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:05.737128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ae9d9449-2a63-4dcb-88e3-6c0125914757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:05.755259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:05.834074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 565/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:06.120793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bf1f8-09ae-4e56-8a9a-f84c5e63734c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:06.122916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-363bf1f8-09ae-4e56-8a9a-f84c5e63734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:06.223835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bf1f8-09ae-4e56-8a9a-f84c5e63734c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:06.289969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:06.297362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:06.297964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:06.298249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:06.298521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:06.300135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:06.406088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:06.407505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a85ab-cbf9-4182-a285-816456fd9dba service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:06.424953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 579/1144] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:08.570102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfadfb-ff01-4a72-81f5-1e2da4bcc594 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:08.570692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfadfb-ff01-4a72-81f5-1e2da4bcc594 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:08.570692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfadfb-ff01-4a72-81f5-1e2da4bcc594 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:08.572108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 566/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:08.578055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d125-c3e2-4828-b74c-0c46731c8d09 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:08.578462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d125-c3e2-4828-b74c-0c46731c8d09 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:08.578601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643d125-c3e2-4828-b74c-0c46731c8d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:08.643776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f643d125-c3e2-4828-b74c-0c46731c8d09 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:08.645037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f643d125-c3e2-4828-b74c-0c46731c8d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:08.691950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:08.740450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 580/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:09.024382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfadfb-ff01-4a72-81f5-1e2da4bcc594 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:09.025902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8fcfadfb-ff01-4a72-81f5-1e2da4bcc594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:09.127756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfadfb-ff01-4a72-81f5-1e2da4bcc594 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:09.175545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:09.201057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:09.201655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:09.201932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:09.202200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:09.203781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:09.311172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:09.312629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb974ed0-01c6-4046-961c-74ae5ec0b07f service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:09.330731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 567/1147] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:18.738879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=22 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:19.328518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=66 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:29.206434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f367d-7f8d-40ed-ac12-5ae20b238892 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:29.206987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f367d-7f8d-40ed-ac12-5ae20b238892 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:29.207101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f367d-7f8d-40ed-ac12-5ae20b238892 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:29.208405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 581/1148] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:29.213683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5d33-2a71-4a38-bf9a-7b22048ddb79 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:29.214096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5d33-2a71-4a38-bf9a-7b22048ddb79 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:29.214200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5d33-2a71-4a38-bf9a-7b22048ddb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:29.280438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-282b5d33-2a71-4a38-bf9a-7b22048ddb79 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:29.281619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-282b5d33-2a71-4a38-bf9a-7b22048ddb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:29.382640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 568/1149] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:29.675853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a63ef-5ca8-4a3c-a85b-cb73f6b868fc None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:29.676169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a63ef-5ca8-4a3c-a85b-cb73f6b868fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:29.676443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a63ef-5ca8-4a3c-a85b-cb73f6b868fc None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:29.677771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 582/1150] 10.222.0.20 () {54 vars in 962 bytes} [Mon Oct 17 03:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:29.682904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7a2f-4057-4e10-a27a-8678009fad92 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:29.683192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7a2f-4057-4e10-a27a-8678009fad92 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:29.683468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e7a2f-4057-4e10-a27a-8678009fad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:29.758994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a63e7a2f-4057-4e10-a27a-8678009fad92 None None] MFA Rules not processed for user `b4351f9211b24b91b2521d717905dbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:29.760254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a63e7a2f-4057-4e10-a27a-8678009fad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:29.780979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:29.834924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 569/1151] 10.222.0.20 () {58 vars in 1059 bytes} [Mon Oct 17 03:06:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:06:29.843092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a63ef-5ca8-4a3c-a85b-cb73f6b868fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:29.844649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cd1a63ef-5ca8-4a3c-a85b-cb73f6b868fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:29.946649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a63ef-5ca8-4a3c-a85b-cb73f6b868fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:30.020380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:30.020979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:30.021258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:30.021528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:30.023101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:30.076593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:30.131584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:30.133032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec78cb9-df71-4a50-ba34-cd467151cb7a service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:30.151171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 583/1152] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:32.389724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948e591-7953-4ba9-9547-cf845d55732e None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:32.390284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948e591-7953-4ba9-9547-cf845d55732e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:32.390284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948e591-7953-4ba9-9547-cf845d55732e None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:32.391654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 570/1153] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:32.396882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2edd5-1134-4e8e-861d-a40524a1112d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:32.397316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2edd5-1134-4e8e-861d-a40524a1112d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:32.397451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2edd5-1134-4e8e-861d-a40524a1112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:32.461813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7ec2edd5-1134-4e8e-861d-a40524a1112d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:32.462991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7ec2edd5-1134-4e8e-861d-a40524a1112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:32.556999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 584/1154] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:32.835107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948e591-7953-4ba9-9547-cf845d55732e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:32.836690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e948e591-7953-4ba9-9547-cf845d55732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:32.960605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948e591-7953-4ba9-9547-cf845d55732e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:33.010388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:33.055004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:33.055604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:33.055893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:33.056181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:33.056811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:33.057908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:06:33.057908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 03:06:33.057908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 03:06:33.059017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8c155-9434-4b05-bdda-3b7fe1046cc8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:33.079260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 571/1155] 10.222.0.20 () {56 vars in 1108 bytes} [Mon Oct 17 03:06:32 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:06:35.208615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb5b6-133b-43ed-8264-32dcdef391f9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:35.209142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb5b6-133b-43ed-8264-32dcdef391f9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:35.209142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33eb5b6-133b-43ed-8264-32dcdef391f9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:35.210604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 585/1156] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:06:35.215908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8c94d-a0d5-4fc0-99fa-1b1accc29377 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:35.216324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8c94d-a0d5-4fc0-99fa-1b1accc29377 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:35.216464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8c94d-a0d5-4fc0-99fa-1b1accc29377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:35.281894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a6e8c94d-a0d5-4fc0-99fa-1b1accc29377 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:35.283088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a6e8c94d-a0d5-4fc0-99fa-1b1accc29377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:35.378093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 572/1157] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:35.672052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb5b6-133b-43ed-8264-32dcdef391f9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:35.673632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b33eb5b6-133b-43ed-8264-32dcdef391f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:35.683327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:35.818894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33eb5b6-133b-43ed-8264-32dcdef391f9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:35.896588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:35.929615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:35.930145 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:35.930418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:35.930689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:35.932291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:36.022202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:36.023808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c45209-907a-4b2d-9323-002d481e2f84 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:36.041441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 586/1158] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:38.334659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa6d10-dea5-458d-9c4a-87969745ce0b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:38.335233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa6d10-dea5-458d-9c4a-87969745ce0b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:38.335233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa6d10-dea5-458d-9c4a-87969745ce0b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:38.336623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 573/1159] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:38.342323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b1df-ad79-4dcb-a41e-d6e748f43691 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:38.342703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b1df-ad79-4dcb-a41e-d6e748f43691 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:38.342865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34b1df-ad79-4dcb-a41e-d6e748f43691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:38.407211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4d34b1df-ad79-4dcb-a41e-d6e748f43691 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:38.408424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d34b1df-ad79-4dcb-a41e-d6e748f43691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:38.452966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:38.501982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 587/1160] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:38.789261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa6d10-dea5-458d-9c4a-87969745ce0b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:38.790835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b2fa6d10-dea5-458d-9c4a-87969745ce0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:38.814889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:38.892670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa6d10-dea5-458d-9c4a-87969745ce0b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:38.963980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:38.964583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:38.964860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:38.965130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:38.966724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:39.040208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:39.075315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:39.076774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e6769-e402-4131-b3e7-a5c2ce919818 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:39.094654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 574/1161] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:41.268830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afee6c-71a4-4a71-8dcf-87cc96607b0c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:41.269370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afee6c-71a4-4a71-8dcf-87cc96607b0c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:41.269370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afee6c-71a4-4a71-8dcf-87cc96607b0c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:41.270771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 588/1162] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:41.275915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70dc6a-223e-4c2a-b0eb-1af3bde527fe None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:41.276338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70dc6a-223e-4c2a-b0eb-1af3bde527fe None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:41.276464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70dc6a-223e-4c2a-b0eb-1af3bde527fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:41.341609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ca70dc6a-223e-4c2a-b0eb-1af3bde527fe None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:41.342848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ca70dc6a-223e-4c2a-b0eb-1af3bde527fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:41.439128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 575/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:41.733805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afee6c-71a4-4a71-8dcf-87cc96607b0c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:41.735350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-70afee6c-71a4-4a71-8dcf-87cc96607b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:41.837659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afee6c-71a4-4a71-8dcf-87cc96607b0c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:41.908802 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:41.910521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:41.911294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:41.911635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:41.912173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:41.914232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:42.023878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:42.025320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7e4df-1d41-4ade-aa7d-b0b396703716 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:42.043233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 589/1164] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:44.238217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd941-5b2c-46d0-abb9-1ea3fc86d3bf None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:44.238740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd941-5b2c-46d0-abb9-1ea3fc86d3bf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:44.238740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fd941-5b2c-46d0-abb9-1ea3fc86d3bf None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:44.240114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 576/1165] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:44.245554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0cdc-a7d4-4a54-a010-67a1073e04d5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:44.245957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0cdc-a7d4-4a54-a010-67a1073e04d5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:44.246140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a0cdc-a7d4-4a54-a010-67a1073e04d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:44.311434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-af5a0cdc-a7d4-4a54-a010-67a1073e04d5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:44.312659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af5a0cdc-a7d4-4a54-a010-67a1073e04d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:44.365776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:44.409839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 590/1166] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:44.704248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fd941-5b2c-46d0-abb9-1ea3fc86d3bf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:44.705825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-167fd941-5b2c-46d0-abb9-1ea3fc86d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:44.741087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:44.807486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fd941-5b2c-46d0-abb9-1ea3fc86d3bf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:44.880530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:44.881134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:44.881412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:44.881685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:44.883254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:44.963261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:44.992910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:44.994328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878e2f4-aae9-4ef0-8d19-5181258735dc service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:45.012838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 577/1167] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:47.430320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc440a-f9ca-437b-8e26-c91f2db5a028 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:47.430895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc440a-f9ca-437b-8e26-c91f2db5a028 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:47.430895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc440a-f9ca-437b-8e26-c91f2db5a028 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:47.432671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 591/1168] 10.222.0.20 () {54 vars in 927 bytes} [Mon Oct 17 03:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:06:47.438135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f24f-706b-4466-9d6d-c2e1e5a88a37 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:47.438602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f24f-706b-4466-9d6d-c2e1e5a88a37 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:47.438710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f24f-706b-4466-9d6d-c2e1e5a88a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:47.504469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-14b2f24f-706b-4466-9d6d-c2e1e5a88a37 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:06:47.505588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-14b2f24f-706b-4466-9d6d-c2e1e5a88a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:47.599996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 578/1169] 10.222.0.20 () {58 vars in 1024 bytes} [Mon Oct 17 03:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:06:47.892839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc440a-f9ca-437b-8e26-c91f2db5a028 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:06:47.894388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-adbc440a-f9ca-437b-8e26-c91f2db5a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:47.996319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc440a-f9ca-437b-8e26-c91f2db5a028 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:06:48.069090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:06:48.069685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:06:48.069962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:06:48.070229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:06:48.071801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:06:48.080594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:48.179448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:06:48.180824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148213c-73c1-4d41-8540-485ff38a6d53 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:06:48.198649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 592/1170] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:06:57.598569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=82 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:06:58.196464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=50 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:07.623486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:07.624115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:07.624115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:07.697831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:08:07.699031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:07.792968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 579/1171] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:08:07.801133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:07.801633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:07.801765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:07.877438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:08:07.878555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:07.973045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 593/1172] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:08:07.977625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:07.978807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:07.990211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc595e11-cac6-45e1-8201-32d7af9f4e89 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:08.049923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:08.085119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:08.085723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.086003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.086274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:08.086916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:08:08.087215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:08.088257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:08:08.088257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 03:08:08.088257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 03:08:08.089149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:08.100011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 580/1173] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:08:08.109784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:08.119313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975b5dc-dc28-45da-b2d4-7a969e4ecd71 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:08.180931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:08.213594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:08.214192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.214466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.214732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:08.215389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:08.216518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:08:08.216518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 03:08:08.216518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 03:08:08.217699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:08.272353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 594/1174] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:08:08 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:08:08.276563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:08.278122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:08.311149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707bc81-5ca6-49e7-b794-e336145caaf3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:08.402029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:08.402622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.402897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.403165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:08.403792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:08.404830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:08:08.404830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 03:08:08.404830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 03:08:08.406150 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:08.447425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 581/1175] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:08:08 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:08:08.451441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:08.453298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:08.514795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20e019-adce-4df8-9535-340882867ab9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:08.596740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:08.608040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:08.609259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.609540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.609813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:08.610472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:08.612365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:08.627037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 595/1176] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:08:08.631131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:08.632679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:08.644526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a207e74-45f2-4f10-9524-bd36c09f0865 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:08.669098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:08.738821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5596c-34b7-4de1-8116-09fd133fb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:08.739354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5596c-34b7-4de1-8116-09fd133fb841 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.739633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5596c-34b7-4de1-8116-09fd133fb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.739930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5596c-34b7-4de1-8116-09fd133fb841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:08.740568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5596c-34b7-4de1-8116-09fd133fb841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:08.742156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5596c-34b7-4de1-8116-09fd133fb841 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:08.754737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 582/1177] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:08:08.758909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:08.760446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:08.792875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf311df9-205c-4944-be50-de27014864f4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:08.883708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ee6c4-5eb0-489e-8abb-bbe791e4c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:08.884391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ee6c4-5eb0-489e-8abb-bbe791e4c032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.884671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ee6c4-5eb0-489e-8abb-bbe791e4c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.884942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ee6c4-5eb0-489e-8abb-bbe791e4c032 admin admin] PATH_INFO: `/v3/projects/0dcf24f2336a4206aba3ff270efd3f61/users/e710382bdfce4c04812cf9c78113f0d3/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:08.907459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ee6c4-5eb0-489e-8abb-bbe791e4c032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcf24f2336a4206aba3ff270efd3f61, user_id=e710382bdfce4c04812cf9c78113f0d3, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:08.910128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ee6c4-5eb0-489e-8abb-bbe791e4c032 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:08.933597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 596/1178] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:08:08 2022] PUT /identity/v3/projects/0dcf24f2336a4206aba3ff270efd3f61/users/e710382bdfce4c04812cf9c78113f0d3/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:08:08.944673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f617e4-8479-4734-8bf6-39293c82b50f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:08.944983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f617e4-8479-4734-8bf6-39293c82b50f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:08.945262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f617e4-8479-4734-8bf6-39293c82b50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.002771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-65f617e4-8479-4734-8bf6-39293c82b50f None None] MFA Rules not processed for user `e710382bdfce4c04812cf9c78113f0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:08:09.004003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-65f617e4-8479-4734-8bf6-39293c82b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:09.080177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 583/1179] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:08:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:08:09.093754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60372-de6e-4469-98a6-0e54a61d9e17 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:09.094038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60372-de6e-4469-98a6-0e54a61d9e17 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:09.094307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60372-de6e-4469-98a6-0e54a61d9e17 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.095670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 597/1180] 10.222.0.20 () {54 vars in 963 bytes} [Mon Oct 17 03:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:08:09.100527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb556-d8e4-4c2e-bbd5-7c6075dcf41d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:09.100814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb556-d8e4-4c2e-bbd5-7c6075dcf41d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:09.101083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcb556-d8e4-4c2e-bbd5-7c6075dcf41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.131724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:09.176348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c6fcb556-d8e4-4c2e-bbd5-7c6075dcf41d None None] MFA Rules not processed for user `6eb1916e113843f6a02c8b80c33b1532`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:08:09.177528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c6fcb556-d8e4-4c2e-bbd5-7c6075dcf41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:09.251131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 584/1181] 10.222.0.20 () {58 vars in 1060 bytes} [Mon Oct 17 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:08:09.259048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60372-de6e-4469-98a6-0e54a61d9e17 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:09.260521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7fa60372-de6e-4469-98a6-0e54a61d9e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:09.309607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:09.363079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60372-de6e-4469-98a6-0e54a61d9e17 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:09.434922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:09.435524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:09.435803 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:09.436107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.438201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:09.535811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:09.537179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:09.540622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:09.555272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 598/1182] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:08:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:08:09.600597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442e467-7e22-46a0-bc1f-5e75f23d38b8 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:09.600891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442e467-7e22-46a0-bc1f-5e75f23d38b8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:09.601163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442e467-7e22-46a0-bc1f-5e75f23d38b8 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.602441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 585/1183] 10.222.0.20 () {52 vars in 830 bytes} [Mon Oct 17 03:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:08:09.605945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:09.607144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:09.705676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c6594-92f4-4aa3-86fd-7560e8988270 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:09.797493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:09.798039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:09.798319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:09.798589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] PATH_INFO: `/v3/users/e710382bdfce4c04812cf9c78113f0d3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.811105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e710382bdfce4c04812cf9c78113f0d3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:09.812696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:08:09.812696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 03:08:09.812696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 03:08:09.813895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:09.823473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:09.881597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e710382bdfce4c04812cf9c78113f0d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:09.895117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e710382bdfce4c04812cf9c78113f0d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:09.895685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e710382bdfce4c04812cf9c78113f0d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:09.896123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e710382bdfce4c04812cf9c78113f0d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:09.905592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e710382bdfce4c04812cf9c78113f0d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:09.933922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 599/1184] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:08:09 2022] DELETE /identity/v3/users/e710382bdfce4c04812cf9c78113f0d3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:08:09.938951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:09.939490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:09.939624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:09.996786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:08:09.998019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:10.072414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:10.085327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 586/1185] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:08:10.095066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:10.096326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:10.193443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6eb0-ea11-4ee0-8ff8-cbedbfd8616d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:10.248331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:10.269759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:10.270361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:10.270636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:10.270902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:10.272506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:10.377755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:10.379105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26ff43-948a-43d6-b9ff-5ef8b75e3a92 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:10.397150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 600/1186] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:08:10.725044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:08:10.726417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:08:10.740246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf7810-647c-4008-bd76-84a795a0449f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:08:10.834274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:08:10.834899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:08:10.835178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:08:10.835448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] PATH_INFO: `/v3/projects/0dcf24f2336a4206aba3ff270efd3f61` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:08:10.845682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcf24f2336a4206aba3ff270efd3f61)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:08:10.846718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:08:10.846718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 03:08:10.846718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 03:08:10.847948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:08:10.903866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcf24f2336a4206aba3ff270efd3f61', 'request_id': 'req-63bac50f-3ad8-4074-9e8e-a6242c137f7b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:10.913435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcf24f2336a4206aba3ff270efd3f61', 'request_id': 'req-63bac50f-3ad8-4074-9e8e-a6242c137f7b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:10.928038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcf24f2336a4206aba3ff270efd3f61', 'request_id': 'req-63bac50f-3ad8-4074-9e8e-a6242c137f7b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:10.951677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] The token cache is being invalidate because project 0dcf24f2336a4206aba3ff270efd3f61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:08:10.952968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:10.952968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-63bac50f-3ad8-4074-9e8e-a6242c137f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:08:10.954431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 587/1187] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:08:10 2022] DELETE /identity/v3/projects/0dcf24f2336a4206aba3ff270efd3f61 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:08:20.394886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=62 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:08:20.949529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:09:43.620797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910bbc5-f08d-4b7b-bf9a-d4bd694dd0d9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:43.621397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910bbc5-f08d-4b7b-bf9a-d4bd694dd0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:43.621397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910bbc5-f08d-4b7b-bf9a-d4bd694dd0d9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:43.622709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 601/1188] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:09:43.627574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10dfff-290f-49d4-940c-2bf5fb5fbbf7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:43.627997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10dfff-290f-49d4-940c-2bf5fb5fbbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:43.628194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10dfff-290f-49d4-940c-2bf5fb5fbbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:43.710182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5e10dfff-290f-49d4-940c-2bf5fb5fbbf7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:09:43.711384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5e10dfff-290f-49d4-940c-2bf5fb5fbbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:43.813009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 588/1189] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:09:43.969175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910bbc5-f08d-4b7b-bf9a-d4bd694dd0d9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:09:43.971897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4910bbc5-f08d-4b7b-bf9a-d4bd694dd0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:44.093561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910bbc5-f08d-4b7b-bf9a-d4bd694dd0d9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:09:44.099575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfb6c1-90c4-42e2-825d-cfd6b2c716c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:09:44.100210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb6c1-90c4-42e2-825d-cfd6b2c716c0 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:44.100495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb6c1-90c4-42e2-825d-cfd6b2c716c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:44.100768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfb6c1-90c4-42e2-825d-cfd6b2c716c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:44.108678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfb6c1-90c4-42e2-825d-cfd6b2c716c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:09:44.110267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfb6c1-90c4-42e2-825d-cfd6b2c716c0 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:09:44.120449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 602/1190] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:09:45.216393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60814c5-de12-461d-87a7-ec1968063e73 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:45.216923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60814c5-de12-461d-87a7-ec1968063e73 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:45.216923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60814c5-de12-461d-87a7-ec1968063e73 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:45.218311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 589/1191] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:09:45.224644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:45.225066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:45.225195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:45.239405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed827845-15e5-4df2-a514-a0ac0cdd488c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:45.239763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed827845-15e5-4df2-a514-a0ac0cdd488c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:45.240136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed827845-15e5-4df2-a514-a0ac0cdd488c None None] PATH_INFO: `/v3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:45.241384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 590/1192] 10.222.0.36 () {54 vars in 925 bytes} [Mon Oct 17 03:09:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:09:45.245574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:09:45.246806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:45.247258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beb0a2-c9a0-4b50-b52b-cf4369c38c62 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:45.247548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beb0a2-c9a0-4b50-b52b-cf4369c38c62 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:45.247825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5beb0a2-c9a0-4b50-b52b-cf4369c38c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:45.255293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 603/1193] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:09:45.308948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e5beb0a2-c9a0-4b50-b52b-cf4369c38c62 None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:09:45.310149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e5beb0a2-c9a0-4b50-b52b-cf4369c38c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:45.341362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:09:45.384142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 591/1194] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Oct 17 03:09:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:09:45.405943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:09:45.418118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cd37-233a-4e7b-b853-0e33caf6813e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:09:45.423500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf2ca5-fd0d-4fa5-a923-d63f4519dcde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:09:45.424661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf2ca5-fd0d-4fa5-a923-d63f4519dcde service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:45.424942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf2ca5-fd0d-4fa5-a923-d63f4519dcde service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:45.425214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf2ca5-fd0d-4fa5-a923-d63f4519dcde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:45.433093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf2ca5-fd0d-4fa5-a923-d63f4519dcde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:09:45.434678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf2ca5-fd0d-4fa5-a923-d63f4519dcde service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:09:45.444516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 604/1195] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:09:48.998812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71f4f-4df1-42a6-9d3e-029ce0f911a6 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:48.999244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71f4f-4df1-42a6-9d3e-029ce0f911a6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:48.999348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f71f4f-4df1-42a6-9d3e-029ce0f911a6 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:49.000716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 592/1196] 10.222.0.20 () {54 vars in 961 bytes} [Mon Oct 17 03:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:09:49.006023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70642-026a-41b5-b1e6-aace99c59f4e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:49.006464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70642-026a-41b5-b1e6-aace99c59f4e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:49.006576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f70642-026a-41b5-b1e6-aace99c59f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:49.026276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a6f70642-026a-41b5-b1e6-aace99c59f4e None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:09:49.027476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a6f70642-026a-41b5-b1e6-aace99c59f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:49.036625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 605/1197] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Oct 17 03:09:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:09:49.044083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f71f4f-4df1-42a6-9d3e-029ce0f911a6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:09:49.057545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f71f4f-4df1-42a6-9d3e-029ce0f911a6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:09:49.063042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2143f5d-98d3-4c87-9ac6-34ee4303d3e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:09:49.063644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2143f5d-98d3-4c87-9ac6-34ee4303d3e1 service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:49.063952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2143f5d-98d3-4c87-9ac6-34ee4303d3e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:49.064237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2143f5d-98d3-4c87-9ac6-34ee4303d3e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:49.074185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2143f5d-98d3-4c87-9ac6-34ee4303d3e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:09:49.075773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2143f5d-98d3-4c87-9ac6-34ee4303d3e1 service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:09:49.085950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 593/1198] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:09:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:09:56.890059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b760d0-64d0-4726-a002-b45c3d227ed1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:56.890655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b760d0-64d0-4726-a002-b45c3d227ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:56.890756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b760d0-64d0-4726-a002-b45c3d227ed1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:56.892115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 606/1199] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:09:56.898513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c2f9-a8c7-41c6-8cac-9c332efdb057 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:56.898976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c2f9-a8c7-41c6-8cac-9c332efdb057 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:56.899094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6c2f9-a8c7-41c6-8cac-9c332efdb057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:56.918522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bed6c2f9-a8c7-41c6-8cac-9c332efdb057 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:09:56.919723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bed6c2f9-a8c7-41c6-8cac-9c332efdb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:56.928170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 594/1200] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:09:57.081844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b760d0-64d0-4726-a002-b45c3d227ed1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:09:57.098169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b760d0-64d0-4726-a002-b45c3d227ed1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:09:57.103656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c81e6-c67b-4ea7-bd90-4629501093bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:09:57.104279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c81e6-c67b-4ea7-bd90-4629501093bd service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:57.104564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c81e6-c67b-4ea7-bd90-4629501093bd service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:57.104839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c81e6-c67b-4ea7-bd90-4629501093bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:57.114231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c81e6-c67b-4ea7-bd90-4629501093bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:09:57.116180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c81e6-c67b-4ea7-bd90-4629501093bd service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:09:57.125718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 607/1201] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:09:58.186466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb2cc-8a14-4597-9c49-0dc2e7174849 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:58.186894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb2cc-8a14-4597-9c49-0dc2e7174849 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:58.187021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdb2cc-8a14-4597-9c49-0dc2e7174849 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:58.188405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 595/1202] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 17 03:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:09:58.195208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837261d9-a69f-4af9-b71a-8f4a2e85a0d9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:58.195666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837261d9-a69f-4af9-b71a-8f4a2e85a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:58.195774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837261d9-a69f-4af9-b71a-8f4a2e85a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:58.214761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-837261d9-a69f-4af9-b71a-8f4a2e85a0d9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:09:58.215913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-837261d9-a69f-4af9-b71a-8f4a2e85a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:09:58.223647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 608/1203] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 17 03:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:09:58.374932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb2cc-8a14-4597-9c49-0dc2e7174849 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:09:58.389517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdb2cc-8a14-4597-9c49-0dc2e7174849 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:09:58.395421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94591e5-93a2-456e-9ad7-c54fcb9d3c6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:09:58.396041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94591e5-93a2-456e-9ad7-c54fcb9d3c6b service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:09:58.396318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94591e5-93a2-456e-9ad7-c54fcb9d3c6b service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:09:58.396588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94591e5-93a2-456e-9ad7-c54fcb9d3c6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:09:58.404351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94591e5-93a2-456e-9ad7-c54fcb9d3c6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:09:58.405900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94591e5-93a2-456e-9ad7-c54fcb9d3c6b service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:09:58.414940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 596/1204] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:10:02.398148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f9b72-82df-45f3-bedd-ccebe55932e4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:02.398687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f9b72-82df-45f3-bedd-ccebe55932e4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:02.398687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f9b72-82df-45f3-bedd-ccebe55932e4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:02.400059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 609/1205] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:10:02.405278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e1ed-0cd3-4444-9f2e-f42ec2803196 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:02.405734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e1ed-0cd3-4444-9f2e-f42ec2803196 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:02.405840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643e1ed-0cd3-4444-9f2e-f42ec2803196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:02.425417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b643e1ed-0cd3-4444-9f2e-f42ec2803196 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:10:02.426621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b643e1ed-0cd3-4444-9f2e-f42ec2803196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:02.434396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 597/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:10:02.716178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f9b72-82df-45f3-bedd-ccebe55932e4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:10:02.717895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-865f9b72-82df-45f3-bedd-ccebe55932e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:02.782594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:10:02.797628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f9b72-82df-45f3-bedd-ccebe55932e4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:10:02.801184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f81d6-462b-4635-ba74-ae0fd34f1689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:10:02.801782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f81d6-462b-4635-ba74-ae0fd34f1689 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:02.802058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f81d6-462b-4635-ba74-ae0fd34f1689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:02.802328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f81d6-462b-4635-ba74-ae0fd34f1689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:02.810972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f81d6-462b-4635-ba74-ae0fd34f1689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:10:02.812422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f81d6-462b-4635-ba74-ae0fd34f1689 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:10:02.822580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 610/1207] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:10:04.946815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c844-c881-4e5d-b17e-bcfedfc230ec None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:04.947407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c844-c881-4e5d-b17e-bcfedfc230ec None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:04.947407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c844-c881-4e5d-b17e-bcfedfc230ec None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:04.948654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 598/1208] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:10:04.954133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a74e2-732b-43d9-8133-13584e991150 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:04.954602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a74e2-732b-43d9-8133-13584e991150 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:04.955267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a74e2-732b-43d9-8133-13584e991150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:04.976600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9a7a74e2-732b-43d9-8133-13584e991150 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:10:04.977818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a7a74e2-732b-43d9-8133-13584e991150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:04.985759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 611/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:10:05.270007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c844-c881-4e5d-b17e-bcfedfc230ec None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:10:05.280900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c844-c881-4e5d-b17e-bcfedfc230ec None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:10:05.284419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3d2c1-632e-4917-aef7-4ca4331700e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:10:05.285012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3d2c1-632e-4917-aef7-4ca4331700e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:05.285294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3d2c1-632e-4917-aef7-4ca4331700e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:05.285569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3d2c1-632e-4917-aef7-4ca4331700e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:05.294398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3d2c1-632e-4917-aef7-4ca4331700e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:10:05.295825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3d2c1-632e-4917-aef7-4ca4331700e9 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:10:05.305140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 599/1210] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:10:08.953459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c3120-f496-46f4-bfcb-a55d0adc755b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:08.954022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c3120-f496-46f4-bfcb-a55d0adc755b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:08.954022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c3120-f496-46f4-bfcb-a55d0adc755b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:08.955977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 612/1211] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:10:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:10:08.961541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae25a41-0bac-4208-8c1b-aa05bae303e8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:08.961923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae25a41-0bac-4208-8c1b-aa05bae303e8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:08.962030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae25a41-0bac-4208-8c1b-aa05bae303e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:08.982327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1ae25a41-0bac-4208-8c1b-aa05bae303e8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:10:08.983553 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1ae25a41-0bac-4208-8c1b-aa05bae303e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:08.991544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 600/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:10:09.290990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c3120-f496-46f4-bfcb-a55d0adc755b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:10:09.292658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae9c3120-f496-46f4-bfcb-a55d0adc755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:09.369039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c3120-f496-46f4-bfcb-a55d0adc755b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:10:09.372556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df649c2b-6288-4087-ad80-d9def43625bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:10:09.373149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df649c2b-6288-4087-ad80-d9def43625bc service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:09.373426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df649c2b-6288-4087-ad80-d9def43625bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:09.373697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df649c2b-6288-4087-ad80-d9def43625bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:09.382443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df649c2b-6288-4087-ad80-d9def43625bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:10:09.383852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df649c2b-6288-4087-ad80-d9def43625bc service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:10:09.393498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 613/1213] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:10:11.522393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c83e90-9244-46cd-a963-42d645dc2f65 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:11.522956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c83e90-9244-46cd-a963-42d645dc2f65 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:11.522956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c83e90-9244-46cd-a963-42d645dc2f65 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:11.524373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 601/1214] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 17 03:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:10:11.529450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408b3f3-ce69-4668-9e11-1cfa00016244 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:11.529875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408b3f3-ce69-4668-9e11-1cfa00016244 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:11.529984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408b3f3-ce69-4668-9e11-1cfa00016244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:11.549573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7408b3f3-ce69-4668-9e11-1cfa00016244 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:10:11.550746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7408b3f3-ce69-4668-9e11-1cfa00016244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:11.558441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 614/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 17 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:10:11.858038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c83e90-9244-46cd-a963-42d645dc2f65 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:10:11.859702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e3c83e90-9244-46cd-a963-42d645dc2f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:10:11.872842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c83e90-9244-46cd-a963-42d645dc2f65 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:10:11.876845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43228815-d364-48ef-9602-40d0da256a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:10:11.877442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228815-d364-48ef-9602-40d0da256a90 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:10:11.877722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228815-d364-48ef-9602-40d0da256a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:10:11.877996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43228815-d364-48ef-9602-40d0da256a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:10:11.886638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43228815-d364-48ef-9602-40d0da256a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:10:11.888096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43228815-d364-48ef-9602-40d0da256a90 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:10:11.897949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 602/1216] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:10:21.544345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=50 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:10:21.893916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=50 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:38.072954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5884-ca0f-4cef-80aa-523d50fc6b34 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.074127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5884-ca0f-4cef-80aa-523d50fc6b34 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.074658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5884-ca0f-4cef-80aa-523d50fc6b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.100023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-408c5884-ca0f-4cef-80aa-523d50fc6b34 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.101328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-408c5884-ca0f-4cef-80aa-523d50fc6b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.111807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 615/1217] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.124220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.124808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.124808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.150266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac4b0d-0c80-4080-95a3-c9f8e8589e7f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.150618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac4b0d-0c80-4080-95a3-c9f8e8589e7f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.151118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac4b0d-0c80-4080-95a3-c9f8e8589e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.157728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.160266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.174817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 603/1218] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.178994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-99ac4b0d-0c80-4080-95a3-c9f8e8589e7f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.180539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-99ac4b0d-0c80-4080-95a3-c9f8e8589e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.187151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.197332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 616/1219] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.203660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ed302-f0b5-4c91-bf70-32bd9f1b8754 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.206049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.206334 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.206606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.218216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.218773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.219053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.219341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.221166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.221473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.223388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.233865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.235076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.255781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 604/1220] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:11:38.258238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 617/1221] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:11:38.262848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.264301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.278245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1b36-4c66-4bb6-b7c2-b7e6af9b0799 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.279189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67336a5-19f3-444e-859a-d86f57fd90ac None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.292580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.293214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.293489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.293761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.294413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.294714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.296524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70970f-6e34-4694-b8c4-a6ffd363b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.297195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad89b-ac6a-4702-8dab-c675ca9e3d6e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.297623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70970f-6e34-4694-b8c4-a6ffd363b0fb admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.298094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70970f-6e34-4694-b8c4-a6ffd363b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.298638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70970f-6e34-4694-b8c4-a6ffd363b0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.299607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70970f-6e34-4694-b8c4-a6ffd363b0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.301867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70970f-6e34-4694-b8c4-a6ffd363b0fb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.317051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 605/1222] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:11:38.318428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d962e6-e759-4ea3-a2ee-a6c57fe34416 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.318708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d962e6-e759-4ea3-a2ee-a6c57fe34416 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.318982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d962e6-e759-4ea3-a2ee-a6c57fe34416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.350997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f7d962e6-e759-4ea3-a2ee-a6c57fe34416 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.352556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f7d962e6-e759-4ea3-a2ee-a6c57fe34416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.359131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 618/1223] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:11:38.361678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0112ec-acc5-45c6-a639-3fc91d6775fe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.362046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0112ec-acc5-45c6-a639-3fc91d6775fe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.362425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0112ec-acc5-45c6-a639-3fc91d6775fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.362918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 606/1224] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.364612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.365067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.365540 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.394949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.395665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1e0112ec-acc5-45c6-a639-3fc91d6775fe None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.396935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1e0112ec-acc5-45c6-a639-3fc91d6775fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.398417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.461902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 607/1225] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.462577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.467327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 619/1226] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.467327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.467327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.467327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.479425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a4377-ec9d-4574-aefa-4be4df7909da None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.484472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.485089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.485379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.485565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.485721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.486790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.487302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.487799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:11:38.487799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 03:11:38.487799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 03:11:38.489275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da4487-e109-42aa-ba86-f1b0e6546827 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.495751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 620/1227] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.497221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.507704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28fe4-e6c1-4c41-a316-fae89205d9d9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.513377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.513982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.514264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.514538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.515174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.516240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:11:38.516240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 03:11:38.516240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 03:11:38.517965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a1be3-065e-429e-a27d-1529a9a7d333 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.522296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 608/1228] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:38.522296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d045ef-dfb7-4906-a08c-af892cc9abea None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.522296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d045ef-dfb7-4906-a08c-af892cc9abea None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.522296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d045ef-dfb7-4906-a08c-af892cc9abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.540542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 621/1229] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:38.541014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-31d045ef-dfb7-4906-a08c-af892cc9abea None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.541781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f3cd-1918-4a60-93ec-dc5c86dc41cb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.542074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f3cd-1918-4a60-93ec-dc5c86dc41cb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.542201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-31d045ef-dfb7-4906-a08c-af892cc9abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.542365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295f3cd-1918-4a60-93ec-dc5c86dc41cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.561933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4295f3cd-1918-4a60-93ec-dc5c86dc41cb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.563125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4295f3cd-1918-4a60-93ec-dc5c86dc41cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.601910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 609/1230] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.603529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00bd97-76b5-4a66-865f-9803b66d12af None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.603812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00bd97-76b5-4a66-865f-9803b66d12af None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.604124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00bd97-76b5-4a66-865f-9803b66d12af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.623694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ad00bd97-76b5-4a66-865f-9803b66d12af None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.625055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ad00bd97-76b5-4a66-865f-9803b66d12af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.635923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 622/1231] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.635923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ad5fb-3814-476f-a3c2-b5d0386a4b92 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.635923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ad5fb-3814-476f-a3c2-b5d0386a4b92 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.635923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ad5fb-3814-476f-a3c2-b5d0386a4b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.636367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 610/1232] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.636367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.636367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.636367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.655542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f45ad5fb-3814-476f-a3c2-b5d0386a4b92 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.656777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f45ad5fb-3814-476f-a3c2-b5d0386a4b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.658494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.659660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.664650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 623/1233] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.665905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.666300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.666573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.668479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 611/1234] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.669239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.679159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a73c4-9ab2-4610-b64f-c0f9ffbf634e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.684921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.685519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.685805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.686076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.686704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.687508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.688659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.688778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.697320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 624/1235] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.697912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.708054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e87d0d-e64f-492d-9526-fda49763a5c8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.711910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 612/1236] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:38.712706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.712830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ae4f-6f80-4dca-9274-458bc7369164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.713488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ae4f-6f80-4dca-9274-458bc7369164 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.713770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ae4f-6f80-4dca-9274-458bc7369164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.714045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ae4f-6f80-4dca-9274-458bc7369164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.714750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ae4f-6f80-4dca-9274-458bc7369164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.716445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ae4f-6f80-4dca-9274-458bc7369164 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.723812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42322d0-cc49-4f88-a295-9107af18bd1e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.727503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 625/1237] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:38.728720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.728871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.729078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.729352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.729608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.729785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.730066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.730717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.731018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.732640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3b974-ed45-47d1-be6f-f5f21b377a01 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.735734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:38.737305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:38.749734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.750921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.759265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 613/1238] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:38.759265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.759265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.759265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.760430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 626/1239] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.760694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.770189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1cc651-5d43-4cef-9c1e-d9b1a30ef4dc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.774785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.775376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.775638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:38.775767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.775944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.776581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.776877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.776981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:38.777893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:11:38.777893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 03:11:38.777893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 03:11:38.778762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.785489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 614/1240] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:38.789810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.791498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 627/1241] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:38.792351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.799781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30803b-ea08-4f32-b9c2-ca3c474497dd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.803757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9260c3e-8946-49ef-872e-7e694f83d555 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.804414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.804944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.805249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.805524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.806164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.806470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.808141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.808392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.809080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.809375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.809655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.810299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.810887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.812495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.820567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 615/1242] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:38.821367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.830996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1758f5-a0e7-4ba3-96a9-5d57c0cf2fb6 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.831356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 628/1243] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:38.832219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.836364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.836962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.837248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.837703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.838459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.840923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.842316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86600bb-18ae-4f26-9e8c-a539760dff52 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.847495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.848108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.848394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.848672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.849340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.850918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.852369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 616/1244] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:38.853543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.864147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 629/1245] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:38.864147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.866790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a6b23-5f67-4029-878d-83a55a49a204 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.871385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.871732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f4edd-216c-4134-92fc-5476b77e5d66 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.872010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.872293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.872568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.873191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.875050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.876358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.877440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.877723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.878026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.878650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.878953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.880552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.892366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 630/1246] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:38.894090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.904468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff08c13-20e7-4b03-a274-b3709dc88595 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.909533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.913171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 617/1247] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:38.913316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.913316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.913540 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.913646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.913646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:38.913646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.913981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:38.925910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 631/1248] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:38.926578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:38.943051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baac82a-0d8e-448c-b7a0-bc0204c8ba9c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.980924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9ce78-350e-4736-b9bc-dca49d7b9ff4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:38.985438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:38.986071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:38.986354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:38.986629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:38.987288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:38.989483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.003053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.003894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.004261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.004630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.005509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.007905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.019041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 618/1249] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.023045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.039652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 632/1250] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:38 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.039652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.084737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855e8dd-a9a1-4689-95b2-c5801970e9ac admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.099231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a4429-4e75-4ad7-bd3e-229861e4c883 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.104112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.104751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.105034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.105311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.105950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.107588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.116593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:39.121167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 633/1251] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.121167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.129079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69b74d-ae19-4f02-87fa-3303ef638173 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.133644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.134297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.134573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.134876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] PATH_INFO: `/v3/projects/267350ef5a1f4008817dd1908050c578/users/fb76b1938c24490fb182d826100502eb/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.144964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.145606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.145891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.146226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:39.146349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.147306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.149659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.150381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267350ef5a1f4008817dd1908050c578, user_id=fb76b1938c24490fb182d826100502eb, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.153582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.168368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 634/1252] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:39 2022] PUT /identity/v3/projects/267350ef5a1f4008817dd1908050c578/users/fb76b1938c24490fb182d826100502eb/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:39.169337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.182199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 619/1253] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.183326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.231549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f004054-73a5-4e46-b2b4-6f8b489c9141 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.247334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf581a-0091-4dfd-99ef-2918a5698bc0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.251983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.252586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.252864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.253134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.253757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.255731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.282767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 620/1254] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.284718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.291528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.292178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.292457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.292726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.293347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.294618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f6d62-5645-4dc1-bc28-46388f67379c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.295242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.301022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.301611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.301891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.302164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.302789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.304718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.325014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 635/1255] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.325014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.336467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 621/1256] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.337376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.383234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcfe5f-756b-460b-914b-4e5396547171 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.399958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495241eb-3c84-412a-aa76-ae41df47db80 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.404595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.405215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.405498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.405771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.406405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.408237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:39.408383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.429491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 622/1257] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.433153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.439681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13893ec2-8edb-4df7-995b-2e1b7fe93660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.440327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13893ec2-8edb-4df7-995b-2e1b7fe93660 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.440609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13893ec2-8edb-4df7-995b-2e1b7fe93660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.440886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13893ec2-8edb-4df7-995b-2e1b7fe93660 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.441502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13893ec2-8edb-4df7-995b-2e1b7fe93660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.443216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad884d-b480-4b51-abc5-542a01caad90 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.443401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13893ec2-8edb-4df7-995b-2e1b7fe93660 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.447791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.448460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.448743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.449022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] PATH_INFO: `/v3/projects/e8a1165750a645628653527ec692e08e/users/64653590b4f645f4aad4ce5958ccb038/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.464534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a1165750a645628653527ec692e08e, user_id=64653590b4f645f4aad4ce5958ccb038, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.467806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 636/1258] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.467806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.467806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.467806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.468223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.470164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:39.484510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 623/1259] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:39 2022] PUT /identity/v3/projects/e8a1165750a645628653527ec692e08e/users/64653590b4f645f4aad4ce5958ccb038/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:39.484913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.496990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] MFA Rules not processed for user `fb76b1938c24490fb182d826100502eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:39.498214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:39.547357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b8f51-ab9d-4fd2-862c-63a9e5f82bf2 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.552063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.552689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.552971 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.553248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.553881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.555979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.561826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 637/1260] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:39.562476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.575447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c905478-15f5-47be-a69f-57455ceb4e3b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.580905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.581514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.581674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 624/1261] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.584817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.584817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.585019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.585137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.585137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.592058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41627473-b80d-40d0-b86f-cb4ca8ef111d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.598463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 638/1262] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.598463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.600438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.601029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.601497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.601797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.602418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.604462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.606077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87966a5-75e7-4afd-9b74-c9926e506feb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.610627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.611242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.611523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.611796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.612446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.614581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.629392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 625/1263] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.629392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.637168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a52f8-0bf1-42c0-8454-a91196fde2c8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.639421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 639/1264] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.640173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.644859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24535bb3-a086-419a-bb60-cd653f345168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.645458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535bb3-a086-419a-bb60-cd653f345168 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.645928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535bb3-a086-419a-bb60-cd653f345168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.646203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24535bb3-a086-419a-bb60-cd653f345168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.646842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24535bb3-a086-419a-bb60-cd653f345168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.648493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24535bb3-a086-419a-bb60-cd653f345168 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.651025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473066b-eb18-4464-a165-c293cf013ff3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.655748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.656378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.656655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.657050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.657554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.659714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.661190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 626/1265] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.662460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.662748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.663023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.673236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 640/1266] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.673236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.691702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] MFA Rules not processed for user `64653590b4f645f4aad4ce5958ccb038`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:39.692954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:39.725208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc112a-f750-4d1d-97a4-0033e6b5d1e0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.728897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.729500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.729781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.730053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.738321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.740107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.748963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 641/1267] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:39.749753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.759605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 627/1268] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:39.759605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.760490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d8196-b2fd-4af8-b9ce-31c264dbd11c service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.765284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.765818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.766106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.766383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.767018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.769240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.771085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8054ec-a31b-443b-bb8e-ad6b6266554a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.774918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:39.775824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.776448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.776758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.776990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.777890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.779552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.780991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 642/1269] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.781823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.791909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 628/1270] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.792082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.795854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b1af-0429-4085-be74-eeb9218c8c5d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.801048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.801644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.801855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d31b4-610d-408e-90e1-434cec099ed7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.801966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.802184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.802821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.804481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.806404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.806981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.807259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.807548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.808323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.809880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.814557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 643/1271] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.816886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.820646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 629/1272] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.821523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.828420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b89e-27ee-4489-90cd-e6f9f9118e47 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.832921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879a15c-da1c-44fb-aa0b-603e4d5bb2b8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.835037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.835641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.835963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.836372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.837018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.838047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.838602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.838728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.838888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.839160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.839787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.841378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.850487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 644/1273] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.851461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.855787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 630/1274] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.855787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.863723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87c065-e515-4ce9-926b-2e9177e780b0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.865949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd0d77-31dc-47b3-9a9c-8e996c5c386c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.868632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.869216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.869492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.869760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.870424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.870994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.871594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.871921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.872025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.872213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.872807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.875365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.877238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:39.883213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 631/1275] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:39.884640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.897501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fcc28-e04c-4476-be80-5a1e4f33a072 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:39.902603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:39.903266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:39.903550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:39.903827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] PATH_INFO: `/v3/projects/e85521421f9d4b89809560c75e6dc728/users/736f6b2ccd4643b5a9eaf762f1e7d15c/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:39.909313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 645/1276] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:39 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:39.909313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.921306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85521421f9d4b89809560c75e6dc728, user_id=736f6b2ccd4643b5a9eaf762f1e7d15c, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:39.924575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:39.939902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 632/1277] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:39 2022] PUT /identity/v3/projects/e85521421f9d4b89809560c75e6dc728/users/736f6b2ccd4643b5a9eaf762f1e7d15c/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:39.940723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:39.989155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6c626-91bd-4577-a1c4-5baf546d9137 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.026626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2f021-ca68-4dbb-9b77-ac86e6699e7d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.032144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.032763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.033174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.033457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.034216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.036237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.046939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 633/1278] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:40.051555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.052427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.053046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.053332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.053608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.054256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.055907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.061840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb221cf-2f00-46a4-b072-9968667db7d8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.069565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 646/1279] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:40.069565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.071378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.072140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.072574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.072854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] PATH_INFO: `/v3/projects/9915c53ba97e41bda583ec0069607c07/users/8c959b30727143f4b15a8a1b1ae8f5be/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.081549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece99b03-ae04-4458-a4e3-46c9b9deaa0f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.086574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.087221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.087500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.087773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] PATH_INFO: `/v3/projects/ec1184bae0104e52a632afad237039e9/users/ac6b35cc3bb844669b3267c846bb03a7/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.091341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9915c53ba97e41bda583ec0069607c07, user_id=8c959b30727143f4b15a8a1b1ae8f5be, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.094020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.105844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1184bae0104e52a632afad237039e9, user_id=ac6b35cc3bb844669b3267c846bb03a7, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.108635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.111552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 634/1280] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:40 2022] PUT /identity/v3/projects/9915c53ba97e41bda583ec0069607c07/users/8c959b30727143f4b15a8a1b1ae8f5be/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:40.112426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.125380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 647/1281] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:40 2022] PUT /identity/v3/projects/ec1184bae0104e52a632afad237039e9/users/ac6b35cc3bb844669b3267c846bb03a7/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:40.126191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.177782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:40.183590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68690677-baa0-4ceb-bc41-1303f15cd7fc admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.208971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c69878-4124-497a-b50c-1530f4d53215 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.215357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd7283-53e7-4a76-8b9e-202cb54d1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.216203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd7283-53e7-4a76-8b9e-202cb54d1b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.216486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd7283-53e7-4a76-8b9e-202cb54d1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.217350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd7283-53e7-4a76-8b9e-202cb54d1b10 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.218113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd7283-53e7-4a76-8b9e-202cb54d1b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.220110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd7283-53e7-4a76-8b9e-202cb54d1b10 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.241344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:40.244703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 648/1282] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:40.246315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.246611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.246913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.251277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.252108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.252460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.252810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] PATH_INFO: `/v3/projects/dfd820190dc746aba6484f95d4043d4e/users/3ce77a2479e84d38845b0eea5e48ae97/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.274594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd820190dc746aba6484f95d4043d4e, user_id=3ce77a2479e84d38845b0eea5e48ae97, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.277626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.292199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] MFA Rules not processed for user `736f6b2ccd4643b5a9eaf762f1e7d15c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.293780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.307722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 635/1283] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:40 2022] PUT /identity/v3/projects/dfd820190dc746aba6484f95d4043d4e/users/3ce77a2479e84d38845b0eea5e48ae97/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:40.308730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.380155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78b63-22d0-44c0-87b0-f96668b2d6e0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.384782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 649/1284] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.385239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a9a23-5448-4a3d-82b7-58b08dfe0b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.386020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9a23-5448-4a3d-82b7-58b08dfe0b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.386396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.386491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9a23-5448-4a3d-82b7-58b08dfe0b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.386635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a9a23-5448-4a3d-82b7-58b08dfe0b43 admin admin] PATH_INFO: `/v3/projects/726d78c8a890424aaba00ba0b5850712/users/286158259165419f818b43de5a69dd74/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.401801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f1d48-b32b-41ac-a5ba-f3e541b06d0c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.417796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0bc9d-92f0-4a05-9ab4-75aac840e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.419973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0bc9d-92f0-4a05-9ab4-75aac840e738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.420376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0bc9d-92f0-4a05-9ab4-75aac840e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.420785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0bc9d-92f0-4a05-9ab4-75aac840e738 admin admin] PATH_INFO: `/v3/projects/8312b0b7c0bc4ff9823b2be972a36500/users/c6859f506b6d4fa288ae9c1acca285cf/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.425503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9a23-5448-4a3d-82b7-58b08dfe0b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726d78c8a890424aaba00ba0b5850712, user_id=286158259165419f818b43de5a69dd74, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.429533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a9a23-5448-4a3d-82b7-58b08dfe0b43 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.438706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0bc9d-92f0-4a05-9ab4-75aac840e738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8312b0b7c0bc4ff9823b2be972a36500, user_id=c6859f506b6d4fa288ae9c1acca285cf, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.444573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0bc9d-92f0-4a05-9ab4-75aac840e738 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.447580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 636/1285] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:40 2022] PUT /identity/v3/projects/726d78c8a890424aaba00ba0b5850712/users/286158259165419f818b43de5a69dd74/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:40.449031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.449418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.449960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.470245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 650/1286] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:40 2022] PUT /identity/v3/projects/8312b0b7c0bc4ff9823b2be972a36500/users/c6859f506b6d4fa288ae9c1acca285cf/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:40.472146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e86d-f96a-4eef-9a79-97f912a932e9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.472440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e86d-f96a-4eef-9a79-97f912a932e9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.472718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263e86d-f96a-4eef-9a79-97f912a932e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.480956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.483130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.503841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3263e86d-f96a-4eef-9a79-97f912a932e9 None None] MFA Rules not processed for user `ac6b35cc3bb844669b3267c846bb03a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.505173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3263e86d-f96a-4eef-9a79-97f912a932e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.548092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 637/1287] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.549613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.559229 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8e84d-2555-48d2-9836-b39485a1f087 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.564487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc8a7f-6958-49cc-8f04-1d31a96f6fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.565092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc8a7f-6958-49cc-8f04-1d31a96f6fba admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.565377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc8a7f-6958-49cc-8f04-1d31a96f6fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.565654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc8a7f-6958-49cc-8f04-1d31a96f6fba admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.566310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc8a7f-6958-49cc-8f04-1d31a96f6fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.567910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecc8a7f-6958-49cc-8f04-1d31a96f6fba admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.571174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 651/1288] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.572441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.572730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.573005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.578358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 638/1289] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:40.580396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bb33-4b01-453e-96fc-32b639b306dc None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.580683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bb33-4b01-453e-96fc-32b639b306dc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.580972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388bb33-4b01-453e-96fc-32b639b306dc None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.582247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 639/1290] 10.222.0.20 () {54 vars in 961 bytes} [Mon Oct 17 03:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:11:40.585022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c8e4d-e3ea-4296-8a19-3cb55c90a752 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.585491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c8e4d-e3ea-4296-8a19-3cb55c90a752 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.585917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c8e4d-e3ea-4296-8a19-3cb55c90a752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.603900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] MFA Rules not processed for user `3ce77a2479e84d38845b0eea5e48ae97`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.605125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.605265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-178c8e4d-e3ea-4296-8a19-3cb55c90a752 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.606416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-178c8e4d-e3ea-4296-8a19-3cb55c90a752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.613941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:40.614736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 640/1291] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.616034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.616324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.616597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.637056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.638446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.647180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 641/1292] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.648004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.675628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 652/1293] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.676615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.687221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dec2a8-94eb-4a5a-997f-8a3eeb5b1103 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.691805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.692434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.692723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.692998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.693624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.694525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:40.695527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.709880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40088e6-0d16-4ccf-823a-73039d25b2a7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.713877 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1b6f5-dc1b-4e88-9114-f6710ac913b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.714509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1b6f5-dc1b-4e88-9114-f6710ac913b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.714768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1b6f5-dc1b-4e88-9114-f6710ac913b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.715038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1b6f5-dc1b-4e88-9114-f6710ac913b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.726028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 653/1294] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:40.726028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.727437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1b6f5-dc1b-4e88-9114-f6710ac913b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.728989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1b6f5-dc1b-4e88-9114-f6710ac913b6 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.739693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 642/1295] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:40.740971 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.741206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.741483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.787902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:40.789039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.791777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d942ca-1f14-468d-99f0-9b67b21e6ce1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.796506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.797171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.797457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.797729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] PATH_INFO: `/v3/projects/b6bd39ef3e9742d288ff648f23a4656a/users/513b118c8c884c54977c18ec2fd19491/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.813503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bd39ef3e9742d288ff648f23a4656a, user_id=513b118c8c884c54977c18ec2fd19491, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:40.816759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:40.836882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 654/1296] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:40 2022] PUT /identity/v3/projects/b6bd39ef3e9742d288ff648f23a4656a/users/513b118c8c884c54977c18ec2fd19491/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:40.837703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.883334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 643/1297] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Oct 17 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:40.890826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:40.892775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:40.910069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fab9c-65e1-462d-be4c-e54b40824698 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.914453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.915196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.915577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.915989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:40.950955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:40.972141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3339931-d23d-4549-8045-040a62fbeb6c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:40.975857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:40.976500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:40.977041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:40.977041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.000770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.003312 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.014702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 655/1298] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:41.015673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.025571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390d9b4-738d-4937-b2cd-2c7f3328bed3 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.030673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.031380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.031655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.032037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.033322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.035226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.055385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.057889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.063152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 656/1299] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:41 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:41.067189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.073367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 644/1300] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:41.074239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.085235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b21212-2755-4731-a175-db99150f87c6 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.090825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:41.165134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.165415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18d352-29e0-4c56-a05f-579da1bb84e7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.167199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.167648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.168523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.169357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.171434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.173884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.174863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.175537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.175537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.176580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.179972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.198264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 645/1301] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:41.205523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.207642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 657/1302] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:41 2022] POST /identity/v3/users => generated 308 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:41.208520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.219803 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5d3dc-7e02-4031-b95e-f5e5b4a02b95 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.227289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.227289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.227587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.227923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.228534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.230463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.261688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 658/1303] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:41 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:41.266913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.303166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66249-f4a8-4684-a11d-1e8bac596f67 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.316176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.317032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.317317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.317644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] PATH_INFO: `/v3/projects/b6bd39ef3e9742d288ff648f23a4656a/users/513b118c8c884c54977c18ec2fd19491/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.319774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bd39ef3e9742d288ff648f23a4656a, user_id=513b118c8c884c54977c18ec2fd19491, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.323015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.339282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 659/1304] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:41 2022] PUT /identity/v3/projects/b6bd39ef3e9742d288ff648f23a4656a/users/513b118c8c884c54977c18ec2fd19491/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:41.339716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba0dd-67fc-4396-81a6-a7709d6b80d5 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.340389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.432360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:41.440119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413413-9141-4483-bf1c-b4a3a559f2a0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.447270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.448087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.448515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.449039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.450093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.452445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.471148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.471999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.472454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.472957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.476939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 660/1305] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:41.478754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.507779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4153eb-828e-494e-abb6-2cc5e0ce6c43 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.536895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c18877-f3fc-48e6-ad22-8f73f761da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.547094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c18877-f3fc-48e6-ad22-8f73f761da69 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.547485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c18877-f3fc-48e6-ad22-8f73f761da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.550211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c18877-f3fc-48e6-ad22-8f73f761da69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.550927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c18877-f3fc-48e6-ad22-8f73f761da69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.558268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c18877-f3fc-48e6-ad22-8f73f761da69 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.590801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 661/1306] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:41.596702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.596996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.597272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.615447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:41.655220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.656245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] MFA Rules not processed for user `513b118c8c884c54977c18ec2fd19491`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:41.657324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.658178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:41.691997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 646/1307] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:41.694248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.752776 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d45d2b-8af9-4e5b-be06-3037a182e656 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.772291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.776966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.778633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.779047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] PATH_INFO: `/v3/projects/69af8d803b894ab89ec4c6eb0f5cfc91/users/ce4760119f924dbb96286da8b478bc6d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.810141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 662/1308] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:41.810141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.829337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69af8d803b894ab89ec4c6eb0f5cfc91, user_id=ce4760119f924dbb96286da8b478bc6d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.834646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b8f55-8014-4c04-b360-cb4dfed9441e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:41.837361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.840984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:41.842467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:41.842753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:41.843786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] PATH_INFO: `/v3/projects/6349bc73f34d432197e1e27564faa5a7/users/1b2307c1df374310b9a1de562c5c5aa3/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:41.867424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 647/1309] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:41 2022] PUT /identity/v3/projects/69af8d803b894ab89ec4c6eb0f5cfc91/users/ce4760119f924dbb96286da8b478bc6d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:41.870121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.886330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6349bc73f34d432197e1e27564faa5a7, user_id=1b2307c1df374310b9a1de562c5c5aa3, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:41.892206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:41.922516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 663/1310] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:41 2022] PUT /identity/v3/projects/6349bc73f34d432197e1e27564faa5a7/users/1b2307c1df374310b9a1de562c5c5aa3/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:41.922516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:41.976446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74062fb-35f4-494e-9e4c-82a595850764 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:42.072613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb077cbd-eac8-41b2-baa2-766c5c31c6e8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:42.081658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:42.082279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.083323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.083669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.085112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:42.089241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:42.105687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a835157-36ea-4c11-9e47-77fd0387c1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:42.106393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835157-36ea-4c11-9e47-77fd0387c1bc service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.106617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835157-36ea-4c11-9e47-77fd0387c1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.106790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 664/1311] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:42.106907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835157-36ea-4c11-9e47-77fd0387c1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.107728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:42.119402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24ec6-defe-4a37-a590-bf827a5b3ef7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:42.125604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396306d1-d4d0-4a79-aaea-47a262db6a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:42.126279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396306d1-d4d0-4a79-aaea-47a262db6a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.126501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396306d1-d4d0-4a79-aaea-47a262db6a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.126970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396306d1-d4d0-4a79-aaea-47a262db6a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.127606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396306d1-d4d0-4a79-aaea-47a262db6a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:42.129698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396306d1-d4d0-4a79-aaea-47a262db6a23 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:42.144247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 665/1312] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:42.144247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98132f-5a21-4c8a-87d1-f86fd84c3f4d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.144247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98132f-5a21-4c8a-87d1-f86fd84c3f4d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.144247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98132f-5a21-4c8a-87d1-f86fd84c3f4d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.145031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 666/1313] 10.222.0.20 () {54 vars in 961 bytes} [Mon Oct 17 03:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:11:42.145652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98132f-5a21-4c8a-87d1-f86fd84c3f4d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:42.162193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98132f-5a21-4c8a-87d1-f86fd84c3f4d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:42.168309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:42.169199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.169655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.169932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] PATH_INFO: `/v3/projects/69af8d803b894ab89ec4c6eb0f5cfc91/users/ce4760119f924dbb96286da8b478bc6d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.172232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69af8d803b894ab89ec4c6eb0f5cfc91, user_id=ce4760119f924dbb96286da8b478bc6d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:42.175844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:42.199031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 667/1314] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:42 2022] PUT /identity/v3/projects/69af8d803b894ab89ec4c6eb0f5cfc91/users/ce4760119f924dbb96286da8b478bc6d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:42.200204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:42.224791 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:42.258188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a835157-36ea-4c11-9e47-77fd0387c1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:42.260888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a835157-36ea-4c11-9e47-77fd0387c1bc service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:42.283192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 648/1315] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:42.286655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17e631-430b-40ed-8a65-7b0dfbfb54ba None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.287789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17e631-430b-40ed-8a65-7b0dfbfb54ba None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.288141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17e631-430b-40ed-8a65-7b0dfbfb54ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.333041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9a17e631-430b-40ed-8a65-7b0dfbfb54ba None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:42.334295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9a17e631-430b-40ed-8a65-7b0dfbfb54ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:42.337631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea944e25-3bdd-4757-bf3a-73c017aab902 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:42.351917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc057c4-fada-4917-b171-7bb4f61adf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:42.352736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc057c4-fada-4917-b171-7bb4f61adf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.353024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc057c4-fada-4917-b171-7bb4f61adf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.353309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc057c4-fada-4917-b171-7bb4f61adf6f admin admin] PATH_INFO: `/v3/projects/6349bc73f34d432197e1e27564faa5a7/users/1b2307c1df374310b9a1de562c5c5aa3/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.357057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc057c4-fada-4917-b171-7bb4f61adf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6349bc73f34d432197e1e27564faa5a7, user_id=1b2307c1df374310b9a1de562c5c5aa3, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:42.363702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc057c4-fada-4917-b171-7bb4f61adf6f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:42.380284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:42.388641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 668/1316] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:42 2022] PUT /identity/v3/projects/6349bc73f34d432197e1e27564faa5a7/users/1b2307c1df374310b9a1de562c5c5aa3/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:42.392843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57b20-9cf3-4e33-b36e-4a25e3481b97 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.393136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57b20-9cf3-4e33-b36e-4a25e3481b97 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.393414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f57b20-9cf3-4e33-b36e-4a25e3481b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.456277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b6f57b20-9cf3-4e33-b36e-4a25e3481b97 None None] MFA Rules not processed for user `ce4760119f924dbb96286da8b478bc6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:42.459677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b6f57b20-9cf3-4e33-b36e-4a25e3481b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:42.484779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 649/1317] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:42.489577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9eb7-232c-4c8a-98fc-1fa0be4950ef None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.489879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9eb7-232c-4c8a-98fc-1fa0be4950ef None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.490160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9eb7-232c-4c8a-98fc-1fa0be4950ef None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.493609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 650/1318] 10.222.0.20 () {54 vars in 912 bytes} [Mon Oct 17 03:11:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:11:42.497931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b214737-f24d-4426-9d3e-5d7402090dd6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.500142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b214737-f24d-4426-9d3e-5d7402090dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.500680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b214737-f24d-4426-9d3e-5d7402090dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.539175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8b214737-f24d-4426-9d3e-5d7402090dd6 None None] MFA Rules not processed for user `1b2307c1df374310b9a1de562c5c5aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:42.540598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8b214737-f24d-4426-9d3e-5d7402090dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:42.617182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 669/1319] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:42.618876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.619360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.619816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.659218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] MFA Rules not processed for user `8c959b30727143f4b15a8a1b1ae8f5be`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:42.660989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:42.678605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 651/1320] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:42.680160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44324d0-b537-4a61-b1de-1fafeef02d6b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.680455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44324d0-b537-4a61-b1de-1fafeef02d6b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.680792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44324d0-b537-4a61-b1de-1fafeef02d6b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.682055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 652/1321] 10.222.0.20 () {54 vars in 912 bytes} [Mon Oct 17 03:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:11:42.683541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f66b-0be5-4bdd-81c6-3244439e3270 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.683906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f66b-0be5-4bdd-81c6-3244439e3270 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.684195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08f66b-0be5-4bdd-81c6-3244439e3270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.712087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-eb08f66b-0be5-4bdd-81c6-3244439e3270 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:42.714354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-eb08f66b-0be5-4bdd-81c6-3244439e3270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:42.803282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 670/1322] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:42.804316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:42.862047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:42.863244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 653/1323] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:42.865231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87800125-bced-4018-959d-a8f46f676871 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.865808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87800125-bced-4018-959d-a8f46f676871 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.866230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87800125-bced-4018-959d-a8f46f676871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.903022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-87800125-bced-4018-959d-a8f46f676871 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:42.904563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-87800125-bced-4018-959d-a8f46f676871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:42.916804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 654/1324] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:42.917899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87800125-bced-4018-959d-a8f46f676871 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:42.922361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8ce13-aacf-4134-a2c4-b02652d9b030 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:42.932141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:42.933130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:42.933738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:42.935303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:42.963901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:42.964980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:42.970462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:42.985385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 671/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:42 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:43.019075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87800125-bced-4018-959d-a8f46f676871 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.028579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.030087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.030474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.030963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.031829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.034712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.053414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.068592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62def8b0-fb4f-4ea1-843a-e2e0ca8ef269 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.079274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.081163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.084655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.085876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.092701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 655/1326] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:42 2022] POST /identity/v3/projects => generated 405 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:43.096801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.118554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.120711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.145661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 672/1327] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:43.172078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.181483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d47d-2ad4-475d-94ad-3e8c70e37c7b service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.265362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551907b-f9a8-4053-9d05-f2c88cd7e010 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.277769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.278400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.278682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.278971 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.279660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.281647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.324848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 656/1328] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:43 2022] POST /identity/v3/users => generated 309 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:43.326041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.330719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.331365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.331650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.331951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.341789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3f777-61df-44ec-8ced-a5f23861c21d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.353370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.354260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.354648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.355022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.467082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.468878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.488705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.494929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.507121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 657/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:43.508389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.531095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 673/1330] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:43.548459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79823d-7a07-4a40-a4e1-6484fee47b46 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.554157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.554787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.555073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.555351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.556041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.558578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.589074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 658/1331] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:43.592996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.610666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b8b0-1a59-480d-ab9d-165d700cbf82 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.619598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.620421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.620899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.621534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] PATH_INFO: `/v3/projects/bcce495ce0da4f568a390be540bd3185/users/0eee64f1a1ad40488cfb74ce7610bfbe/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.657435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcce495ce0da4f568a390be540bd3185, user_id=0eee64f1a1ad40488cfb74ce7610bfbe, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.664804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.703738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 674/1332] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:43 2022] PUT /identity/v3/projects/bcce495ce0da4f568a390be540bd3185/users/0eee64f1a1ad40488cfb74ce7610bfbe/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:43.708862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.722490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117faebd-88f8-472f-98a6-48101266cc30 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.775610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:43.867566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.868240 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.868536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.868807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.870463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.872290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.902294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 659/1333] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:43.905741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:43.921617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19178c14-c46a-4548-ac1a-bf33c96d9a2a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:43.937667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:43.938383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:43.938662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:43.939464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] PATH_INFO: `/v3/projects/bcce495ce0da4f568a390be540bd3185/users/0eee64f1a1ad40488cfb74ce7610bfbe/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:43.950524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcce495ce0da4f568a390be540bd3185, user_id=0eee64f1a1ad40488cfb74ce7610bfbe, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:43.953395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:43.973630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 675/1334] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:43 2022] PUT /identity/v3/projects/bcce495ce0da4f568a390be540bd3185/users/0eee64f1a1ad40488cfb74ce7610bfbe/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:11:44.201350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:44.357435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e230da-77c3-49b2-a257-64e912a0464c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:44.508728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf9900-5416-403d-9790-d7f524622382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:44.510339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf9900-5416-403d-9790-d7f524622382 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:44.510808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf9900-5416-403d-9790-d7f524622382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:44.511176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf9900-5416-403d-9790-d7f524622382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:44.663825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf9900-5416-403d-9790-d7f524622382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:44.669145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf9900-5416-403d-9790-d7f524622382 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:44.686217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 660/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:44.809507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:44.882335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:45.049999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60759e5-a5e6-467f-9c25-318994b52d8b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:45.060367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:45.061038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:45.061325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:45.061609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] PATH_INFO: `/v3/users/ac6b35cc3bb844669b3267c846bb03a7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:45.063025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6b35cc3bb844669b3267c846bb03a7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:45.065120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:45.196597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6b35cc3bb844669b3267c846bb03a7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:45.216610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6b35cc3bb844669b3267c846bb03a7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:45.218338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6b35cc3bb844669b3267c846bb03a7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:45.219142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6b35cc3bb844669b3267c846bb03a7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:45.253554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6b35cc3bb844669b3267c846bb03a7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:45.318927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 676/1336] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:44 2022] DELETE /identity/v3/users/ac6b35cc3bb844669b3267c846bb03a7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:45.319815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:45.320314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:45.320846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:45.411089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:45.418672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:45.494494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:45.623062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 661/1337] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:45.637819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:45.640368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:45.823830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be32c3-7fdf-4d5d-9141-7556a1e266c6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:45.839253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f4d2a-fde3-4bd8-8f96-2135777f39db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:45.841943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4d2a-fde3-4bd8-8f96-2135777f39db service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:45.844918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4d2a-fde3-4bd8-8f96-2135777f39db service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:45.847354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f4d2a-fde3-4bd8-8f96-2135777f39db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:45.881084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4d2a-fde3-4bd8-8f96-2135777f39db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:45.885272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f4d2a-fde3-4bd8-8f96-2135777f39db service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:45.913359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 677/1338] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:46.164786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:46.166873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:46.190242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c02fa-98d7-46f6-a1af-1c1e8951eb87 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:46.217453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:46.218135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:46.218418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:46.218693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] PATH_INFO: `/v3/users/3ce77a2479e84d38845b0eea5e48ae97` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:46.222823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce77a2479e84d38845b0eea5e48ae97)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:46.223416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: WARNING py.warnings [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:11:46.223416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: warnings.warn(msg) Oct 17 03:11:46.223416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: Oct 17 03:11:46.224772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:46.423466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce77a2479e84d38845b0eea5e48ae97'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:46.511602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce77a2479e84d38845b0eea5e48ae97'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:46.515426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce77a2479e84d38845b0eea5e48ae97'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:46.521679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce77a2479e84d38845b0eea5e48ae97'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:46.554095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce77a2479e84d38845b0eea5e48ae97'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:46.666126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 662/1339] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:46 2022] DELETE /identity/v3/users/3ce77a2479e84d38845b0eea5e48ae97 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:46.670969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a484d86-f2bd-48e4-b1f1-ccd302efbde5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:46.671785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a484d86-f2bd-48e4-b1f1-ccd302efbde5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:46.672293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a484d86-f2bd-48e4-b1f1-ccd302efbde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:46.731540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5a484d86-f2bd-48e4-b1f1-ccd302efbde5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:46.737128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a484d86-f2bd-48e4-b1f1-ccd302efbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:46.906557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:46.993831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 678/1340] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:47.000607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:47.002818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:47.168832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4de16e-013f-48e3-94ec-a2ec1aa863a8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:47.178194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:47.181125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:47.182003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:47.182003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:47.211703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:47.217111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:47.239400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:47.239691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:47.240183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:47.259352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 663/1341] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:47.334532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] MFA Rules not processed for user `0eee64f1a1ad40488cfb74ce7610bfbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:47.337214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:47.510149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 679/1342] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:47 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:48.051899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:48.053457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:48.083481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88675174-26e3-4428-b501-63613f2a3e09 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:48.106475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:48.107137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:48.107418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:48.107692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] PATH_INFO: `/v3/projects/dfd820190dc746aba6484f95d4043d4e` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:48.111030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd820190dc746aba6484f95d4043d4e)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:48.119755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:48.145495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:48.148039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:48.197183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86ae59-52b6-473a-9318-3ee04d49de29 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:48.233291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:48.234085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:48.236599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:48.239146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] PATH_INFO: `/v3/projects/ec1184bae0104e52a632afad237039e9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:48.242918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1184bae0104e52a632afad237039e9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:48.245792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 17 03:11:48.245792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: warnings.warn(msg) Oct 17 03:11:48.245792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: Oct 17 03:11:48.247558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:48.259535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:48.295641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd820190dc746aba6484f95d4043d4e', 'request_id': 'req-6baf0424-11e8-4d69-a6e5-b18738f3331b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.316813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd820190dc746aba6484f95d4043d4e', 'request_id': 'req-6baf0424-11e8-4d69-a6e5-b18738f3331b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.359817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd820190dc746aba6484f95d4043d4e', 'request_id': 'req-6baf0424-11e8-4d69-a6e5-b18738f3331b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.430432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] The token cache is being invalidate because project dfd820190dc746aba6484f95d4043d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:48.432888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.433789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.437134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 664/1343] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:48 2022] DELETE /identity/v3/projects/dfd820190dc746aba6484f95d4043d4e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:48.443670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:48.448202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:48.569762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1184bae0104e52a632afad237039e9', 'request_id': 'req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.593988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1184bae0104e52a632afad237039e9', 'request_id': 'req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.640605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1184bae0104e52a632afad237039e9', 'request_id': 'req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.645870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf0424-11e8-4d69-a6e5-b18738f3331b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:48.667362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] The token cache is being invalidate because project ec1184bae0104e52a632afad237039e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:48.672158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.672943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.684676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 680/1344] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:48 2022] DELETE /identity/v3/projects/ec1184bae0104e52a632afad237039e9 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:48.684935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:48.693397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:48.806471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:48.807180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:48.807457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:48.807725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] PATH_INFO: `/v3/users/736f6b2ccd4643b5a9eaf762f1e7d15c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:48.810670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=736f6b2ccd4643b5a9eaf762f1e7d15c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:48.812661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:48.838090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:48.866631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9deaa-d734-4d5d-be6d-6c567a1d1a9a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:48.891170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:48.892653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:48.893321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:48.893590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] PATH_INFO: `/v3/users/1b2307c1df374310b9a1de562c5c5aa3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:48.895142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2307c1df374310b9a1de562c5c5aa3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:48.900404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:48.931987 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736f6b2ccd4643b5a9eaf762f1e7d15c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.963129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736f6b2ccd4643b5a9eaf762f1e7d15c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.965493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736f6b2ccd4643b5a9eaf762f1e7d15c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.966159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736f6b2ccd4643b5a9eaf762f1e7d15c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:48.976068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736f6b2ccd4643b5a9eaf762f1e7d15c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.007675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:49.057000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 665/1345] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:48 2022] DELETE /identity/v3/users/736f6b2ccd4643b5a9eaf762f1e7d15c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:49.060033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:49.064009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:49.070009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2307c1df374310b9a1de562c5c5aa3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.083359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2307c1df374310b9a1de562c5c5aa3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.090556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2307c1df374310b9a1de562c5c5aa3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.090993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2307c1df374310b9a1de562c5c5aa3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.103637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-06e0307c-4a87-4fed-836a-145941988f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2307c1df374310b9a1de562c5c5aa3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.150184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 681/1346] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:48 2022] DELETE /identity/v3/users/1b2307c1df374310b9a1de562c5c5aa3 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:49.152669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:49.153233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:49.155978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:49.217711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:49.220642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:49.261346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75ef9c-4490-4da7-8423-e8a78bd42e10 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:49.321321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 682/1347] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:49.396246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:49.397936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:49.401477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:49.402132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:49.433122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:49.433586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] PATH_INFO: `/v3/users/ce4760119f924dbb96286da8b478bc6d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:49.436728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4760119f924dbb96286da8b478bc6d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:49.439221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:49.562386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d4800-19d5-4620-a8ce-7f00473a207e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:49.570059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd93978-3ae8-4f9f-8d31-7ff4e3f00ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:49.570786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd93978-3ae8-4f9f-8d31-7ff4e3f00ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:49.572841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd93978-3ae8-4f9f-8d31-7ff4e3f00ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:49.574337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd93978-3ae8-4f9f-8d31-7ff4e3f00ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:49.586732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4760119f924dbb96286da8b478bc6d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.601295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd93978-3ae8-4f9f-8d31-7ff4e3f00ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:49.606630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd93978-3ae8-4f9f-8d31-7ff4e3f00ed2 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:49.623112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 683/1348] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:49.636462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4760119f924dbb96286da8b478bc6d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.637304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4760119f924dbb96286da8b478bc6d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.637997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4760119f924dbb96286da8b478bc6d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.655585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5357df9f-a235-4d61-a687-0fcbb7790c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4760119f924dbb96286da8b478bc6d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:49.694551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 666/1349] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:49 2022] DELETE /identity/v3/users/ce4760119f924dbb96286da8b478bc6d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:49.777177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099300-b9e4-47a1-8cfb-8fe0459119ae None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:49.777617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099300-b9e4-47a1-8cfb-8fe0459119ae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:49.778054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e099300-b9e4-47a1-8cfb-8fe0459119ae None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:49.780128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 684/1350] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:11:49.868882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:49.869422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:49.869966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:49.906345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:49.910041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:49.923655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:50.077637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 667/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:11:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:50.123673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e099300-b9e4-47a1-8cfb-8fe0459119ae None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:50.126094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e099300-b9e4-47a1-8cfb-8fe0459119ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:50.144007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:50.174005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:50.175420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:50.200725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29329d6-47a4-452c-8ee6-97f75073772e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:50.219670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caeb23-cfb0-40ff-81f0-5924e0ac0726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:50.223790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caeb23-cfb0-40ff-81f0-5924e0ac0726 service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:50.224486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caeb23-cfb0-40ff-81f0-5924e0ac0726 service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:50.224968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caeb23-cfb0-40ff-81f0-5924e0ac0726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:50.266937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caeb23-cfb0-40ff-81f0-5924e0ac0726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:50.269772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caeb23-cfb0-40ff-81f0-5924e0ac0726 service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:50.298596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 668/1352] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:50.312501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e099300-b9e4-47a1-8cfb-8fe0459119ae None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:50.318741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:50.319933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:50.320386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:50.320814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] PATH_INFO: `/v3/users/64653590b4f645f4aad4ce5958ccb038` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:50.322725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64653590b4f645f4aad4ce5958ccb038)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:50.325475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:50.427818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64653590b4f645f4aad4ce5958ccb038'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:50.436369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64653590b4f645f4aad4ce5958ccb038'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:50.437317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64653590b4f645f4aad4ce5958ccb038'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:50.438566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64653590b4f645f4aad4ce5958ccb038'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:50.456050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64653590b4f645f4aad4ce5958ccb038'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:50.502355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 685/1353] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:50 2022] DELETE /identity/v3/users/64653590b4f645f4aad4ce5958ccb038 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:50.507089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:50.507373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:50.507663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:50.549938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:50.551620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:50.662606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 669/1354] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:50.692147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:50.693496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:50.783119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211da30-78c2-4c90-a08e-74978ca69b33 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:50.790787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bef8-7f1a-4b0a-b2b2-c15169d97ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:50.791441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bef8-7f1a-4b0a-b2b2-c15169d97ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:50.791830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bef8-7f1a-4b0a-b2b2-c15169d97ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:50.792210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bef8-7f1a-4b0a-b2b2-c15169d97ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:50.806031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1bef8-7f1a-4b0a-b2b2-c15169d97ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:50.807772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1bef8-7f1a-4b0a-b2b2-c15169d97ce6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:50.828340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 686/1355] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:51.139774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:51.141457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.165769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab98f8f-bf1b-4f43-8a0e-445f92c1e41b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:51.181034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:51.181942 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.183003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.183527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] PATH_INFO: `/v3/projects/e85521421f9d4b89809560c75e6dc728` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.185245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85521421f9d4b89809560c75e6dc728)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:51.190794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:51.306607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85521421f9d4b89809560c75e6dc728', 'request_id': 'req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.323426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85521421f9d4b89809560c75e6dc728', 'request_id': 'req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.333349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85521421f9d4b89809560c75e6dc728', 'request_id': 'req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.359913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] The token cache is being invalidate because project e85521421f9d4b89809560c75e6dc728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:51.360314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.361883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2961e8a8-3b3d-476b-a6cc-b9e92a9b90f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.364068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 670/1356] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:51 2022] DELETE /identity/v3/projects/e85521421f9d4b89809560c75e6dc728 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:51.368641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.369519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.369990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.393891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:51.395454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.428785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658f40-8f8b-446b-a439-a8f8d72b4b49 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.429169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658f40-8f8b-446b-a439-a8f8d72b4b49 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.429582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6658f40-8f8b-446b-a439-a8f8d72b4b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.462554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:51.473533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d6658f40-8f8b-446b-a439-a8f8d72b4b49 None None] MFA Rules not processed for user `c6859f506b6d4fa288ae9c1acca285cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:51.476510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d6658f40-8f8b-446b-a439-a8f8d72b4b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.484943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:51.512443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 687/1357] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:11:51.513505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:51.520597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.538924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d0da4-6c24-4053-94a0-f82107482dbb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:51.549901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:51.550881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.551219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.551494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] PATH_INFO: `/v3/projects/6349bc73f34d432197e1e27564faa5a7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.552857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6349bc73f34d432197e1e27564faa5a7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:51.555203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:51.585172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 671/1358] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:51.587738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7d529-519b-4120-91f5-84d1f3931290 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.588069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7d529-519b-4120-91f5-84d1f3931290 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.588386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7d529-519b-4120-91f5-84d1f3931290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.615619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7fc7d529-519b-4120-91f5-84d1f3931290 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:51.617866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7fc7d529-519b-4120-91f5-84d1f3931290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.632088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6349bc73f34d432197e1e27564faa5a7', 'request_id': 'req-dedf948a-f66d-4d2b-a5f1-25bdd2995373'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.644234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6349bc73f34d432197e1e27564faa5a7', 'request_id': 'req-dedf948a-f66d-4d2b-a5f1-25bdd2995373'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.662291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6349bc73f34d432197e1e27564faa5a7', 'request_id': 'req-dedf948a-f66d-4d2b-a5f1-25bdd2995373'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.682171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] The token cache is being invalidate because project 6349bc73f34d432197e1e27564faa5a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:51.682171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.683164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dedf948a-f66d-4d2b-a5f1-25bdd2995373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:51.688213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 688/1359] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:51 2022] DELETE /identity/v3/projects/6349bc73f34d432197e1e27564faa5a7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:51.691711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ad22b-5474-4d70-8d74-fd6a22cfb0e0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.693485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ad22b-5474-4d70-8d74-fd6a22cfb0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.693775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ad22b-5474-4d70-8d74-fd6a22cfb0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.715889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a80ad22b-5474-4d70-8d74-fd6a22cfb0e0 None None] MFA Rules not processed for user `c6859f506b6d4fa288ae9c1acca285cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:51.717170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a80ad22b-5474-4d70-8d74-fd6a22cfb0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.723973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 672/1360] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:51.726061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.726701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.727169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.752302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:51.754085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.774025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 673/1361] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:51.775171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:51.790097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65963-569a-48d8-b577-c3fd18105f96 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:51.798930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:51.799706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.800359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.800734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.801626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:51.802090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:51.803380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 689/1362] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:51.808735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:51.820912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.824319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.824863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.830677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 674/1363] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:51.831705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:51.833978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.859232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:51.861267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:51.876554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 690/1364] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:51.876554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:51.895181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33927-d791-498e-b345-83d0db731ba0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:51.901413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:51.902639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:51.903006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:51.903374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:51.904131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:51.907102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:51.949837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 691/1365] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:51 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:51.950851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.017986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:52.019904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1b275-a1af-4931-9c2c-f346a28f6000 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.078538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:52.084390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076820c-3f9f-4379-9355-308ada236768 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.097972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.098666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.099081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.099451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.100865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:52.102157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.104798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.125291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 692/1366] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:52.126391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.150062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f31b5-ad6a-49c3-9aa5-cffaad93f5f5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.155619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.156915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.157438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.157905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.160117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:52.163911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.165788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.166612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.168550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.170193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.179859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.236695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 693/1367] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:52 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:52.238810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.250749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cc98-dad6-4799-a6da-44b527e9bec4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.257572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.259267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.260283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.260283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.261890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.264455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.288469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.290319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.305773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 675/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:52.307886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 694/1369] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:52 2022] POST /identity/v3/projects => generated 361 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:52.313227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.315099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.317614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:52.321027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:52.366571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa9fee-7480-418c-9b12-e5732b9b352b service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.490488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29d4db-38b0-4e84-83ad-5897dcda50a1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.501536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.502589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.502873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.503547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.503833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.504135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] PATH_INFO: `/v3/projects/e8a1165750a645628653527ec692e08e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.505359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.505754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] PATH_INFO: `/v3/projects/69af8d803b894ab89ec4c6eb0f5cfc91` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.507189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69af8d803b894ab89ec4c6eb0f5cfc91)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.508471 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a1165750a645628653527ec692e08e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.510156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.512637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.604598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a1165750a645628653527ec692e08e', 'request_id': 'req-fb823b4e-6ad6-4526-869b-8380c5df8c27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.620386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a1165750a645628653527ec692e08e', 'request_id': 'req-fb823b4e-6ad6-4526-869b-8380c5df8c27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.635715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a1165750a645628653527ec692e08e', 'request_id': 'req-fb823b4e-6ad6-4526-869b-8380c5df8c27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.644581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69af8d803b894ab89ec4c6eb0f5cfc91', 'request_id': 'req-44d77e0f-fb96-4000-bf58-15364eeddab0'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.659897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69af8d803b894ab89ec4c6eb0f5cfc91', 'request_id': 'req-44d77e0f-fb96-4000-bf58-15364eeddab0'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.668759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] The token cache is being invalidate because project e8a1165750a645628653527ec692e08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:52.668759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.668928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69af8d803b894ab89ec4c6eb0f5cfc91', 'request_id': 'req-44d77e0f-fb96-4000-bf58-15364eeddab0'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.669551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.672497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:52.675670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 695/1370] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:52 2022] DELETE /identity/v3/projects/e8a1165750a645628653527ec692e08e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:52.677746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.681259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:52.688620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] The token cache is being invalidate because project 69af8d803b894ab89ec4c6eb0f5cfc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:52.688946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.689805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:52.695425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 676/1371] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:52 2022] DELETE /identity/v3/projects/69af8d803b894ab89ec4c6eb0f5cfc91 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:52.696354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.699483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:52.718509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:52.824309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb823b4e-6ad6-4526-869b-8380c5df8c27 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.853422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d77e0f-fb96-4000-bf58-15364eeddab0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.866799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.867437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.867723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.868024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.869302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.873914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.914917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 677/1372] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:52 2022] POST /identity/v3/users => generated 281 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:52.915806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:52.921446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:52.962928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a42ef8-02be-4290-b630-a1293b87e710 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:52.975130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.976284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.976689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.977057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.978093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.978840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:52.979415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:52.979746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:52.980569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] PATH_INFO: `/v3/users/8c959b30727143f4b15a8a1b1ae8f5be` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:52.980676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:52.981612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c959b30727143f4b15a8a1b1ae8f5be)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:52.986326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.042004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 696/1373] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:53.042004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.051961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.073952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab02bf-c00b-4406-be6f-b9c7e58538c0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.082746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.084423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.084708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.085045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] PATH_INFO: `/v3/users/513b118c8c884c54977c18ec2fd19491` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.086624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513b118c8c884c54977c18ec2fd19491)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.090406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.117716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c959b30727143f4b15a8a1b1ae8f5be'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.137363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c959b30727143f4b15a8a1b1ae8f5be'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.138542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c959b30727143f4b15a8a1b1ae8f5be'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.140300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c959b30727143f4b15a8a1b1ae8f5be'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.150959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5c2d595b-f975-413d-8442-f9259f6d6a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c959b30727143f4b15a8a1b1ae8f5be'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.172120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513b118c8c884c54977c18ec2fd19491'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.181858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 678/1374] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:52 2022] DELETE /identity/v3/users/8c959b30727143f4b15a8a1b1ae8f5be => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:53.181858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.181858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.181858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.190207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513b118c8c884c54977c18ec2fd19491'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.191225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513b118c8c884c54977c18ec2fd19491'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.192170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513b118c8c884c54977c18ec2fd19491'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.206112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:53.207359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.209430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eada4fd-5c68-4b65-bbbf-09cfe3651276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513b118c8c884c54977c18ec2fd19491'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:53.237965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 697/1375] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:53 2022] DELETE /identity/v3/users/513b118c8c884c54977c18ec2fd19491 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:53.237965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.237965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.237965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.273499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] MFA Rules not processed for user `286158259165419f818b43de5a69dd74`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:53.274805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.304051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:53.330719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:53.349317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 679/1376] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:53.350480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.352462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.374596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09006b-209c-4632-9492-9246543ecbb5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.384393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 698/1377] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:53.386894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.404265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.486701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713750-aebc-4f6a-87e4-65539620908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.487743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713750-aebc-4f6a-87e4-65539620908f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.488125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713750-aebc-4f6a-87e4-65539620908f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.488745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713750-aebc-4f6a-87e4-65539620908f admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.489481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713750-aebc-4f6a-87e4-65539620908f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.491166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713750-aebc-4f6a-87e4-65539620908f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.508451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 680/1378] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:53.513271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d850713-0877-4533-855a-7813f061c58c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.513642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d850713-0877-4533-855a-7813f061c58c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.513996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d850713-0877-4533-855a-7813f061c58c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.515469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 681/1379] 10.222.0.20 () {54 vars in 912 bytes} [Mon Oct 17 03:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:11:53.520191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd9db5-ae98-42d8-bdf5-c53156d9c980 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.526194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.526525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.526817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.526927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.527092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.527188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.527365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.528311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.530176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.550904 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 699/1380] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:53.553201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:53.554578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.556672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.558597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.564219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 682/1381] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:53.565275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.585559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73397493-ffd9-4d80-9d4c-a0e80d15f05e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.594973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afab23-b188-4a93-bfc7-bce563678286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.595980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afab23-b188-4a93-bfc7-bce563678286 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.596123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afab23-b188-4a93-bfc7-bce563678286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.596475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afab23-b188-4a93-bfc7-bce563678286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.597193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afab23-b188-4a93-bfc7-bce563678286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.598953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afab23-b188-4a93-bfc7-bce563678286 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.613630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 683/1382] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:53.620584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.620584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.620584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.671688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:53.674253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:53.775371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 684/1383] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:11:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:53.777040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.793554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47f306-fab6-441e-88f2-e8144385da0a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.799467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.800514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.801149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.801536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] PATH_INFO: `/v3/projects/cf270e91f62d41c39dc22c185edc1ff0/users/1f41e1e2e9dd4448bea1d6d08d35aca8/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.815252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255e14f-3457-4c44-8cbf-ea191c4c0676 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.823678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf270e91f62d41c39dc22c185edc1ff0, user_id=1f41e1e2e9dd4448bea1d6d08d35aca8, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.823851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.824535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.824822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.825100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.826661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.842505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.846124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:53.852743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 685/1384] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:53 2022] PUT /identity/v3/projects/cf270e91f62d41c39dc22c185edc1ff0/users/1f41e1e2e9dd4448bea1d6d08d35aca8/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:53.853699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.861311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 700/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:53.866341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:53.881598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da880d-667f-4b1a-97c5-3b21799d6015 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.933583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:53.962513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:53.967454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27f04-c165-455e-aa43-31945bf72f41 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:53.979827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:53.981810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:53.982121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:53.983551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:53.984258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:53.984582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:53.986426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.000866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:54.002119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.002395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.002694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] PATH_INFO: `/v3/projects/69e94ec58a0349eea76e7fecccd5655a/users/95c2a8d7192b48e49d9b98c2de1bab4c/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.005306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 686/1386] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:54.006454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:54.010389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.027346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237ba9b-d9e8-4a06-adb4-775200977f53 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:54.039446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:54.040730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.041020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.041300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] PATH_INFO: `/v3/projects/9915c53ba97e41bda583ec0069607c07` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.042583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e94ec58a0349eea76e7fecccd5655a, user_id=95c2a8d7192b48e49d9b98c2de1bab4c, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:54.044455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=9915c53ba97e41bda583ec0069607c07)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:54.046373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.047037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.092680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 701/1387] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:53 2022] PUT /identity/v3/projects/69e94ec58a0349eea76e7fecccd5655a/users/95c2a8d7192b48e49d9b98c2de1bab4c/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:54.093792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:54.096681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.123913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9915c53ba97e41bda583ec0069607c07', 'request_id': 'req-382e7b7a-a0a4-4144-8cc7-973aa272cdde'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.134628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9915c53ba97e41bda583ec0069607c07', 'request_id': 'req-382e7b7a-a0a4-4144-8cc7-973aa272cdde'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.147005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9915c53ba97e41bda583ec0069607c07', 'request_id': 'req-382e7b7a-a0a4-4144-8cc7-973aa272cdde'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.165633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] The token cache is being invalidate because project 9915c53ba97e41bda583ec0069607c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:54.166045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.166775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.169023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 687/1388] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:54 2022] DELETE /identity/v3/projects/9915c53ba97e41bda583ec0069607c07 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:54.170177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:54.172179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.210179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0032b0-e6f6-49e0-aef6-843d699d1737 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:54.277370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e7b7a-a0a4-4144-8cc7-973aa272cdde admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:54.294609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:54.295434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.295944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.296184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] PATH_INFO: `/v3/projects/b6bd39ef3e9742d288ff648f23a4656a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.298913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bd39ef3e9742d288ff648f23a4656a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:54.300887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.306662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:54.308231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.308512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.308938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.313549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.330349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:54.332099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ef9c4-db7e-4e9b-ab8a-8b207d06f0a6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.352868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 702/1389] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:54.355134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.358141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.358805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.387254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bd39ef3e9742d288ff648f23a4656a', 'request_id': 'req-50eb510e-02b9-4e47-b562-2bb21004fa81'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.402114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bd39ef3e9742d288ff648f23a4656a', 'request_id': 'req-50eb510e-02b9-4e47-b562-2bb21004fa81'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.413019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bd39ef3e9742d288ff648f23a4656a', 'request_id': 'req-50eb510e-02b9-4e47-b562-2bb21004fa81'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.426437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:54.435246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] MFA Rules not processed for user `1f41e1e2e9dd4448bea1d6d08d35aca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:54.436664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.447792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] The token cache is being invalidate because project b6bd39ef3e9742d288ff648f23a4656a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:54.448126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.453041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.455684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 688/1390] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:54 2022] DELETE /identity/v3/projects/b6bd39ef3e9742d288ff648f23a4656a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:54.456702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:54.461359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.603533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 703/1391] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:54.608913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:54.608913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.642094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb510e-02b9-4e47-b562-2bb21004fa81 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:54.647618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960db02-8784-4094-acbb-f91d0a80d7e2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:54.652788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:54.653620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.653815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87795b-71fd-4998-922c-e63842353f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:54.654178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.654446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87795b-71fd-4998-922c-e63842353f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.654730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87795b-71fd-4998-922c-e63842353f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.655006 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87795b-71fd-4998-922c-e63842353f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.655119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] PATH_INFO: `/v3/users/fb76b1938c24490fb182d826100502eb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.656403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87795b-71fd-4998-922c-e63842353f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:54.661202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb76b1938c24490fb182d826100502eb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:54.663132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87795b-71fd-4998-922c-e63842353f8e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.677331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:54.709820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:54.733364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 689/1392] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:54 2022] POST /identity/v3/projects => generated 373 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:54.737137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8039a-b773-4a8e-b35d-38f3f7b7b795 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.738214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8039a-b773-4a8e-b35d-38f3f7b7b795 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.738755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8039a-b773-4a8e-b35d-38f3f7b7b795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:54.798238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8dc8039a-b773-4a8e-b35d-38f3f7b7b795 None None] MFA Rules not processed for user `95c2a8d7192b48e49d9b98c2de1bab4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:54.799831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8dc8039a-b773-4a8e-b35d-38f3f7b7b795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.819148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb76b1938c24490fb182d826100502eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.836795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb76b1938c24490fb182d826100502eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.840001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb76b1938c24490fb182d826100502eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.840558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb76b1938c24490fb182d826100502eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.859485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb76b1938c24490fb182d826100502eb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:54.896811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 704/1393] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:54 2022] DELETE /identity/v3/users/fb76b1938c24490fb182d826100502eb => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:54.897719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:54.906987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:54.971949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 690/1394] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:54.971949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:54.971949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:54.971949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.022051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:55.029618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.050784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a588-2b98-4d7a-bd49-98e8c49260ae admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.052763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 691/1395] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:55.053711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.055213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.068148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.068822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.069098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.069380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] PATH_INFO: `/v3/users/0eee64f1a1ad40488cfb74ce7610bfbe` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.073788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eee64f1a1ad40488cfb74ce7610bfbe)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.081861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:55.175135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eee64f1a1ad40488cfb74ce7610bfbe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:55.191373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eee64f1a1ad40488cfb74ce7610bfbe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:55.192551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eee64f1a1ad40488cfb74ce7610bfbe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:55.193690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eee64f1a1ad40488cfb74ce7610bfbe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:55.205928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eee64f1a1ad40488cfb74ce7610bfbe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:55.215493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:55.234097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 705/1396] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:54 2022] DELETE /identity/v3/users/0eee64f1a1ad40488cfb74ce7610bfbe => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:55.235365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.238510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.242146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad7f9f-2ed3-4abb-9895-f47b98eff0cc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.255668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:55.366867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee6026-a23c-4dab-b0a2-4f8bedcbc262 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.373307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e17fd2-108d-4f71-b486-02c48844f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.374127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17fd2-108d-4f71-b486-02c48844f7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.374703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17fd2-108d-4f71-b486-02c48844f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.375075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e17fd2-108d-4f71-b486-02c48844f7a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.376575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e17fd2-108d-4f71-b486-02c48844f7a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.379412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.380082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.380369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.380584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e17fd2-108d-4f71-b486-02c48844f7a5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:55.380715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.384857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.478854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 706/1397] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:55 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:55.480513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.481406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.481406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.503098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.504767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ee8e42-a72c-4167-b948-701db5c3e02b service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:55.508144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:55.509643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.519574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 707/1398] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:55.524565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.526633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.541759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 692/1399] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:55.547058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.547396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.552936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.559715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef025d-ee32-4686-a441-30873ddb00fe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.574367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.575559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.576124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.576619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.577604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.582043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:55.612083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:55.617895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.650881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 693/1400] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:55.651857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.653345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.670331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 708/1401] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:55 2022] POST /identity/v3/projects => generated 359 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:55.672403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.784846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec6b71-e4b7-4dec-b9b8-6d3fe7a44ec3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.859814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:55.860118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db20bf-78d3-4e06-8d0a-6aec6e5ce79e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.860118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.860118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.860118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.862537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.862537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.862537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:55.894595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 709/1402] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:55.908535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.910543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.910667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.911179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.911462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.911941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.913632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.931403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.933124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:55.963839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 694/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:55.964941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:55.966129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:55.982990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141619a2-3075-4f73-886e-4db0eaac49bd service placement] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.990002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:55.990656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:55.990931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:55.991205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] PATH_INFO: `/v3/projects/bcce495ce0da4f568a390be540bd3185` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:55.991575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31545b1-1d81-496c-8e0e-b909618eeb66 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:55.993138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcce495ce0da4f568a390be540bd3185)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:55.995760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.002160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.002796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.003079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.003354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.025182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.026875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.053911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 710/1404] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:56.054987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.106031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d98a8-bfcb-4ab5-85b7-827f06288729 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.111796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:56.129554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcce495ce0da4f568a390be540bd3185', 'request_id': 'req-73277235-9039-4a24-a884-3cc164c95515'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.144061 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcce495ce0da4f568a390be540bd3185', 'request_id': 'req-73277235-9039-4a24-a884-3cc164c95515'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.156704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcce495ce0da4f568a390be540bd3185', 'request_id': 'req-73277235-9039-4a24-a884-3cc164c95515'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.186162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] The token cache is being invalidate because project bcce495ce0da4f568a390be540bd3185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:56.187917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.189860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.196890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 695/1405] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:55 2022] DELETE /identity/v3/projects/bcce495ce0da4f568a390be540bd3185 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:56.199224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.207218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.289240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.290018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.290471 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.291749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.292467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:56.292826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.296384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.335094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 711/1406] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:56.335094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.336511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.359609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29053067-7998-4d15-9737-9053601db1a5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.367376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.368268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.368593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.368905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.369693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.373245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.401727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 712/1407] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:56.402899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.405083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.430059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b5378-f4a2-4744-a704-b2503db51175 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.443279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.445073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.445619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73277235-9039-4a24-a884-3cc164c95515 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.446944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.449868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] PATH_INFO: `/v3/users/1f41e1e2e9dd4448bea1d6d08d35aca8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.454542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f41e1e2e9dd4448bea1d6d08d35aca8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.460214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.461615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b556517-bccf-4a00-8b46-cfa3d534bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.462445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b556517-bccf-4a00-8b46-cfa3d534bdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.462809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b556517-bccf-4a00-8b46-cfa3d534bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.463185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b556517-bccf-4a00-8b46-cfa3d534bdb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.464209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b556517-bccf-4a00-8b46-cfa3d534bdb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.466244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b556517-bccf-4a00-8b46-cfa3d534bdb3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.519053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 696/1408] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:56 2022] POST /identity/v3/users => generated 286 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:56.520850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.522250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.522853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.571223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:56.579836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.598175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 697/1409] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:56.599027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.605600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.634842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30ccc4-02bd-426b-8562-50561b9751ad None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.643815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f41e1e2e9dd4448bea1d6d08d35aca8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.650039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.651002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.651295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.651706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.653270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.655142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.664150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f41e1e2e9dd4448bea1d6d08d35aca8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.665105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f41e1e2e9dd4448bea1d6d08d35aca8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.665813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f41e1e2e9dd4448bea1d6d08d35aca8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.677498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f41e1e2e9dd4448bea1d6d08d35aca8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:56.712907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 713/1410] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:11:56 2022] DELETE /identity/v3/users/1f41e1e2e9dd4448bea1d6d08d35aca8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:56.712907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.717329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.730718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 698/1411] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:56 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:56.731737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:56.738951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:56.757973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:56.830121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50848c7a-4088-46ee-837d-092f97b13793 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.836238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:56.912214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b15260-9df3-4c75-976a-0ac130e657d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.913124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15260-9df3-4c75-976a-0ac130e657d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.913531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15260-9df3-4c75-976a-0ac130e657d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.913904 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b15260-9df3-4c75-976a-0ac130e657d1 admin admin] PATH_INFO: `/v3/projects/ac4beaf1f7b44210b4d3cc21a83c34b5/users/ed15ced7fae246658d754e32a5c48884/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.925711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520438bb-767f-4262-a907-e7c71727a71c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:56.936251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d870d6-d22a-49e6-b6da-e830c0b96eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:56.937162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d870d6-d22a-49e6-b6da-e830c0b96eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.937656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d870d6-d22a-49e6-b6da-e830c0b96eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.938078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d870d6-d22a-49e6-b6da-e830c0b96eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.939432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d870d6-d22a-49e6-b6da-e830c0b96eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.941450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d870d6-d22a-49e6-b6da-e830c0b96eaf admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.941660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15260-9df3-4c75-976a-0ac130e657d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4beaf1f7b44210b4d3cc21a83c34b5, user_id=ed15ced7fae246658d754e32a5c48884, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:56.946975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b15260-9df3-4c75-976a-0ac130e657d1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:56.968920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 699/1412] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:56.968920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.968920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.968920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.982346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 714/1413] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:56 2022] PUT /identity/v3/projects/ac4beaf1f7b44210b4d3cc21a83c34b5/users/ed15ced7fae246658d754e32a5c48884/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:56.991389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:56.991736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:56.993755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:56.998089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:57.000742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.038980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:57.038980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.112067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 700/1414] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:57.114498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.117728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.147613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405278-3981-4d20-b3fa-ee1ec5a8498c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.166460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.167112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.167405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.167687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.168399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.170345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.176679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 715/1415] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:57.176679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.184448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.204858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03031896-d85b-4106-ab34-72e9493fa8c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.210745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.211440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.211724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.212038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] PATH_INFO: `/v3/projects/267350ef5a1f4008817dd1908050c578` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.213887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267350ef5a1f4008817dd1908050c578)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.216253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.219329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 701/1416] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:57 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:57.221306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.237504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe70c1-81c7-4ec8-8fab-82389166c910 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.249480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5f314-3334-4e9b-9719-2aefcb3b1eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.250180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f314-3334-4e9b-9719-2aefcb3b1eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.250468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f314-3334-4e9b-9719-2aefcb3b1eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.250752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5f314-3334-4e9b-9719-2aefcb3b1eea admin admin] PATH_INFO: `/v3/projects/460b60cb0b684c20aa4f5ee4effbb3b6/users/2acd5551839a434ca218e47dffa36923/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.312385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f314-3334-4e9b-9719-2aefcb3b1eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=460b60cb0b684c20aa4f5ee4effbb3b6, user_id=2acd5551839a434ca218e47dffa36923, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.317522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5f314-3334-4e9b-9719-2aefcb3b1eea admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.329737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267350ef5a1f4008817dd1908050c578', 'request_id': 'req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:57.344924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267350ef5a1f4008817dd1908050c578', 'request_id': 'req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:57.347533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 702/1417] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:57 2022] PUT /identity/v3/projects/460b60cb0b684c20aa4f5ee4effbb3b6/users/2acd5551839a434ca218e47dffa36923/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:57.350437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.351017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.351131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.354753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267350ef5a1f4008817dd1908050c578', 'request_id': 'req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:57.370830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] The token cache is being invalidate because project 267350ef5a1f4008817dd1908050c578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:57.371257 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:57.372190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3f02c47-a2f6-477d-ac2d-845fadbd4ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:57.374574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 716/1418] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:57 2022] DELETE /identity/v3/projects/267350ef5a1f4008817dd1908050c578 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:57.379451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.379766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.380123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.399001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] MFA Rules not processed for user `ed15ced7fae246658d754e32a5c48884`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:57.401227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.408380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] MFA Rules not processed for user `286158259165419f818b43de5a69dd74`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:57.409675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.421503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:57.464331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:57.481952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 717/1419] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:57.483191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.484995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.496952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 703/1420] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:57.499077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.501495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.595902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dcd9a2-b955-4568-8b13-aef9c22bab7e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.597919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a81a-3ad0-44a5-b9e9-ecec2463ce91 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.603945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.604543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.604792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.604922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.605119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.605367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.605754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.606089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.606805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:57.607211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.609414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.611238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.634154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.635611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.658278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 718/1422] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:57.659900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.660975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 704/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:57.661968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.662581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.669084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.697286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97a582-74f3-4cac-ac67-2ffcbcf2a1ff admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.703362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749d260-3143-48da-a248-e2afa7a9d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.704334 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d260-3143-48da-a248-e2afa7a9d7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.704798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d260-3143-48da-a248-e2afa7a9d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.705247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d260-3143-48da-a248-e2afa7a9d7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.706514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749d260-3143-48da-a248-e2afa7a9d7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.708983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749d260-3143-48da-a248-e2afa7a9d7a8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.718884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b826a8-c798-4ecf-be21-e7ead8efd62e service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.724133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 719/1423] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:57.725826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.727835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.728326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.736783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.738172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.739389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.740433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.742639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.746425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.773790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 705/1424] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:57.773790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.774420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.783315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:57.787313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:57.790197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777fb24-a216-48a5-94f3-1fa5b716c0bd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.800370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.802140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.802427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.803843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.805418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.810506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 720/1425] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:57.811106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.812587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.835324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383669ee-b74b-47ae-9ed1-a3682f5f59f9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:57.855934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:57.857127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:57.857127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:57.857409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:57.861533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:57.869260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:57.894106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 706/1426] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:57 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:57.897165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:57.949926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 721/1427] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:57 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:57.956701 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.105064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6364440-aa50-4807-9b82-9a5c777daf6f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.266407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306ef47-5a1d-4de2-b615-6d464a31bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.267355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306ef47-5a1d-4de2-b615-6d464a31bfdf admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.267782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306ef47-5a1d-4de2-b615-6d464a31bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.268766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306ef47-5a1d-4de2-b615-6d464a31bfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.269787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306ef47-5a1d-4de2-b615-6d464a31bfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:58.272801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306ef47-5a1d-4de2-b615-6d464a31bfdf admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:58.289492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 707/1428] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:58.290918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.291211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.291498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.307191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:58.319098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41697c32-61cf-4b27-b008-d087b40abde7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.326903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.327714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.328076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.328301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] PATH_INFO: `/v3/projects/460b60cb0b684c20aa4f5ee4effbb3b6/users/2acd5551839a434ca218e47dffa36923/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.331699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=460b60cb0b684c20aa4f5ee4effbb3b6, user_id=2acd5551839a434ca218e47dffa36923, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:58.336021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:58.339577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:58.340972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:58.360100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 722/1429] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:57 2022] PUT /identity/v3/projects/460b60cb0b684c20aa4f5ee4effbb3b6/users/2acd5551839a434ca218e47dffa36923/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:58.361340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.395294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:58.444366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 708/1430] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:58.445304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.458876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3c089-f595-4d07-bb9d-196be0cc3aa8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.465748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.466645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.466837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.467369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.480493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:58.488157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:58.494182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a05694-0d17-4fbd-a8de-d3e94a7134ae admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.511074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.513462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.514507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.514953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.516178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:58.520662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:58.541686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 709/1431] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:58 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:58.545981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.551220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:58.560602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 723/1432] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:58 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:58.562939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.582933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e73e9e-17eb-4ce2-936d-dfb602daa353 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.584335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc697e-825a-4198-a106-8eec96b60ad0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.603261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.604621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373e965-f0ba-4748-8623-22c08ecfeb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.622006 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.623053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373e965-f0ba-4748-8623-22c08ecfeb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.623503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.623882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] PATH_INFO: `/v3/projects/cf270e91f62d41c39dc22c185edc1ff0` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.624376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373e965-f0ba-4748-8623-22c08ecfeb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.625299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373e965-f0ba-4748-8623-22c08ecfeb42 admin admin] PATH_INFO: `/v3/projects/073cbcebe9f64a00846672e24948ff3b/users/d4aa6dd99f40485db19f34bcf3662dac/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.627240 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf270e91f62d41c39dc22c185edc1ff0)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:58.632637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:58.667459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373e965-f0ba-4748-8623-22c08ecfeb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073cbcebe9f64a00846672e24948ff3b, user_id=d4aa6dd99f40485db19f34bcf3662dac, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:58.679476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373e965-f0ba-4748-8623-22c08ecfeb42 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:58.703328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 724/1433] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:58 2022] PUT /identity/v3/projects/073cbcebe9f64a00846672e24948ff3b/users/d4aa6dd99f40485db19f34bcf3662dac/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:58.709194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.709638 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.710107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.778494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] MFA Rules not processed for user `2acd5551839a434ca218e47dffa36923`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:58.782304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:58.785848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf270e91f62d41c39dc22c185edc1ff0', 'request_id': 'req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:58.801499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf270e91f62d41c39dc22c185edc1ff0', 'request_id': 'req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:58.812255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf270e91f62d41c39dc22c185edc1ff0', 'request_id': 'req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:58.837569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] The token cache is being invalidate because project cf270e91f62d41c39dc22c185edc1ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:11:58.838689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:58.840443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:11:58.842815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 710/1434] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:11:58 2022] DELETE /identity/v3/projects/cf270e91f62d41c39dc22c185edc1ff0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:58.843501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.861081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:58.913473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 725/1435] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:58.914971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:58.917143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:58.987814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aecaf-4146-46d6-bc13-3fdad0c8cf01 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:58.995165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:58.996274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:58.996680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:58.997188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:58.997978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:11:58.998390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.000147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.015575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 711/1436] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:11:59.018040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.020127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.041221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b96fc9-4326-4862-a532-87eb70ecaf84 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.043275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:59.051132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4a91e-cb4f-44c6-862e-73d88935db14 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.053962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2215888-1716-4067-a752-cd05cab494b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.067149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2215888-1716-4067-a752-cd05cab494b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.067498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2215888-1716-4067-a752-cd05cab494b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.067783 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2215888-1716-4067-a752-cd05cab494b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.070841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2215888-1716-4067-a752-cd05cab494b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.072391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2c7ee-8dda-4645-8f85-25ed811bf41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.072656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2215888-1716-4067-a752-cd05cab494b7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.073029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c7ee-8dda-4645-8f85-25ed811bf41a admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.073316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c7ee-8dda-4645-8f85-25ed811bf41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.073592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2c7ee-8dda-4645-8f85-25ed811bf41a admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.074242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c7ee-8dda-4645-8f85-25ed811bf41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.075507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:59.076060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2c7ee-8dda-4645-8f85-25ed811bf41a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.096850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 726/1437] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:59.096850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.096850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.096850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.123568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 712/1438] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:59.123568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.123568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.123568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.133964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] MFA Rules not processed for user `d4aa6dd99f40485db19f34bcf3662dac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:59.135373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.151452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:59.153143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.168436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 713/1439] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:59.169458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.172249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.245664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 727/1440] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:59.247505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.257684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60689a73-3efa-4327-a4c4-ef6faa68a0dd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.261866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.263090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.263608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.264036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.273968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d090ce-01fd-46f5-993f-9047d4f6632c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.277178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.280403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.283480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf1b54-a494-44de-86a0-be352a6471ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.284360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1b54-a494-44de-86a0-be352a6471ab admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.287146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1b54-a494-44de-86a0-be352a6471ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.287585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf1b54-a494-44de-86a0-be352a6471ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.288531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf1b54-a494-44de-86a0-be352a6471ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.291286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf1b54-a494-44de-86a0-be352a6471ab admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.333034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 714/1441] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:11:59.335337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.357055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 728/1442] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:59.359468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.360741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.360741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.373509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681b0ac-28cf-4c1f-ad16-5e016288c6fb service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.459065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.459638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.460197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.460501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.461249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.463000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.478933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 715/1443] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:11:59.480714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.496456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37498308-8836-4631-ac76-f6025c5d60bd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.502289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c25ef5-5146-4084-ab85-db699891cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.503036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25ef5-5146-4084-ab85-db699891cfe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.503391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25ef5-5146-4084-ab85-db699891cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.503807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c25ef5-5146-4084-ab85-db699891cfe7 admin admin] PATH_INFO: `/v3/projects/37eeb38268f34efdb14d89ca1348a58d/users/d13f8c419416498aae0a6da65127bed5/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.513002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:59.514428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.533812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c25ef5-5146-4084-ab85-db699891cfe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37eeb38268f34efdb14d89ca1348a58d, user_id=d13f8c419416498aae0a6da65127bed5, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.539307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c25ef5-5146-4084-ab85-db699891cfe7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.569392 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 716/1444] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:59 2022] PUT /identity/v3/projects/37eeb38268f34efdb14d89ca1348a58d/users/d13f8c419416498aae0a6da65127bed5/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:11:59.573809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.574260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.574748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.620834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 729/1445] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:59.643458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.645053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.667270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839f1dc-5873-4e74-b6fd-1a4e2130d420 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.670383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:11:59.682129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:11:59.730843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:59.796742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.797406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.797837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.800141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.800819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.806075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 717/1446] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:11:59.806538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.807465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.814691 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:11:59.823344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbd392-2b75-4811-b4e7-34d0cb8a8a58 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.839296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.840065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.840427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.840929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.841687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:11:59.845472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:11:59.859321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 730/1447] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:59.859493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.888655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 718/1448] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:11:59 2022] POST /identity/v3/users => generated 291 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:11:59.890083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:11:59.913249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad73e21-936b-48f4-8aca-9bcf888809e1 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.963945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146298f-d0e2-4c8c-b65d-e7ec8e9bf692 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:11:59.970129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:11:59.970860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:11:59.971203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:11:59.971548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:11:59.974583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:00.027974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.029371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.030344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] PATH_INFO: `/v3/projects/e75d9fd385424e1cad7d865a6e1a7207/users/b68c4a83207b4f3185c66ff8203a77d8/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.051545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.053496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.058852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75d9fd385424e1cad7d865a6e1a7207, user_id=b68c4a83207b4f3185c66ff8203a77d8, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.061561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.080495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 719/1449] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:11:59 2022] PUT /identity/v3/projects/e75d9fd385424e1cad7d865a6e1a7207/users/b68c4a83207b4f3185c66ff8203a77d8/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:00.087146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 731/1450] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:11:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:00.088050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.091843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.111427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3486541-7dc7-47d0-9cac-f10fef2250c3 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.191766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5892a07-63db-4441-ae2f-6b736e2f91be admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.198359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.199258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.201002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.201277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.202037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.203760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.221572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 720/1451] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:00.222709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.226600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:00.240138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.240942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.241232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.241507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.242255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:00.242562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.244580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.274161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 732/1452] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:00.275242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.294166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29073b-568f-405c-b828-41a4c72a2138 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.303414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.304393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.304814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.305224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.306158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.308305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.320055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:00.346998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 733/1453] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:00 2022] POST /identity/v3/users => generated 302 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:00.347957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.364899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030e1f-3051-480b-886b-c12a6209f51b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.372602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8eea6-db85-4783-9282-aec1baa61c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.373391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8eea6-db85-4783-9282-aec1baa61c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.373801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8eea6-db85-4783-9282-aec1baa61c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.374075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8eea6-db85-4783-9282-aec1baa61c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.374726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8eea6-db85-4783-9282-aec1baa61c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.376571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8eea6-db85-4783-9282-aec1baa61c42 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.399277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:00.399817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 734/1454] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:00.402252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53cf7f-d976-46da-b601-40d35bb7f262 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.402882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53cf7f-d976-46da-b601-40d35bb7f262 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.403298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53cf7f-d976-46da-b601-40d35bb7f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.447502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e4b85-2642-4b65-b140-32d0a86bf8ca admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.451144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2c53cf7f-d976-46da-b601-40d35bb7f262 None None] MFA Rules not processed for user `b68c4a83207b4f3185c66ff8203a77d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:00.452874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c53cf7f-d976-46da-b601-40d35bb7f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:00.454662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.455368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.455730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.456331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.548518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.550638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.562972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 721/1455] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:12:00.564739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 735/1456] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:00.567106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.568429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.568841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.582197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.600714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ef81a-04c0-4dc5-a68d-9a7bdfb71f70 service swift] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.614316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:00.619786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:00.623551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.624280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.624563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.624840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] PATH_INFO: `/v3/projects/37eeb38268f34efdb14d89ca1348a58d/users/d13f8c419416498aae0a6da65127bed5/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.627614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=37eeb38268f34efdb14d89ca1348a58d, user_id=d13f8c419416498aae0a6da65127bed5, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.630317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:00.696749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 722/1457] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:00 2022] PUT /identity/v3/projects/37eeb38268f34efdb14d89ca1348a58d/users/d13f8c419416498aae0a6da65127bed5/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:00.697537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.736954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 736/1458] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Oct 17 03:12:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:00.738846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:00.757282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c077b1c-b183-4e55-9cf6-c324b19828ae None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.934400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21c6a6-fda4-4ad3-a544-607639b352ad admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:00.965032 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:00.967232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:00.967800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:00.970284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:00.971251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:00.980909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.017435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.020283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.020597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.020917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.025149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.029911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.062790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 737/1459] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:01.068477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.072342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 723/1460] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:00 2022] POST /identity/v3/projects => generated 381 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:01.073273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.102552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86245c0f-5127-42bc-a006-db549da109d9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:01.144107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:01.218688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:01.228488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb906c-ef62-4911-b884-62f976cf7550 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:01.248371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.249169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.249560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.249947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.251243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.254106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.284669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d616-f738-429d-bf59-a9f3fd50fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.286790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d616-f738-429d-bf59-a9f3fd50fcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.287797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d616-f738-429d-bf59-a9f3fd50fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.288465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d616-f738-429d-bf59-a9f3fd50fcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.289646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0d616-f738-429d-bf59-a9f3fd50fcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.292526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0d616-f738-429d-bf59-a9f3fd50fcc6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.320947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 738/1461] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:01.322734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 724/1462] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:01 2022] POST /identity/v3/projects => generated 355 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:01.322985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.323288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.323590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.324103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.378855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] MFA Rules not processed for user `d13f8c419416498aae0a6da65127bed5`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:01.381127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:01.455134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7ee80-c470-4fb7-b28b-656d77a1816f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:01.467697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.468500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.468720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.471012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] PATH_INFO: `/v3/projects/38461e55911e407bb19fd7df589795d2/users/3192ad9b19b84932807f3f1a48c9b52e/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.499710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38461e55911e407bb19fd7df589795d2, user_id=3192ad9b19b84932807f3f1a48c9b52e, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.505444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.533527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 725/1463] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:01 2022] PUT /identity/v3/projects/38461e55911e407bb19fd7df589795d2/users/3192ad9b19b84932807f3f1a48c9b52e/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:01.534690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.555720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 739/1464] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:01.561609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.562933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:01.682779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b32ad-be9a-499a-a02a-cbb0de355b38 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:01.712330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.712906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.713224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.713506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.714609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.716784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.717698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5911-8649-44f8-ac46-d178030e26c7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:01.783940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 726/1465] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:01 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:01.784748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.832815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b92354-a69a-47ea-b7bf-96104537a869 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:01.843849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.849088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.850792 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.852846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] PATH_INFO: `/v3/projects/3b4b75ced2244dcea6999dc96ed170d2/users/308cfa1f2c034e85960bd16b0953c39a/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.855589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:01.858931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:01.863171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:01.872070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:01.896247 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:01.902718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.905531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.921355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4b75ced2244dcea6999dc96ed170d2, user_id=308cfa1f2c034e85960bd16b0953c39a, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:01.924845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:01.943865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 740/1466] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:01.972486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:01.986288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 727/1467] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:01 2022] PUT /identity/v3/projects/3b4b75ced2244dcea6999dc96ed170d2/users/308cfa1f2c034e85960bd16b0953c39a/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:01.987778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:02.030180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ae4c-1cca-4bf5-a0fa-74698e82b5f3 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.116059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:02.218219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14494e6-bcc0-449d-9e64-cc37c921f2aa admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.235745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:02.237141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.237604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.238023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.239077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:02.242983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:02.286725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 728/1468] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:02.287563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:02.292747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:02.318315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:02.318988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.319272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.319980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.320249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:02.322243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:02.397378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 741/1469] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:01 2022] POST /identity/v3/users => generated 284 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:02.397378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:02.420812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd657545-85ab-4a07-b5e2-bc76e0661c3d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.432193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cf07b-68a5-4a69-8643-4a89ff93a07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:02.433422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf07b-68a5-4a69-8643-4a89ff93a07e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.434041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf07b-68a5-4a69-8643-4a89ff93a07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.434462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cf07b-68a5-4a69-8643-4a89ff93a07e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.436657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf07b-68a5-4a69-8643-4a89ff93a07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:02.440700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cf07b-68a5-4a69-8643-4a89ff93a07e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:02.443546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6730dd8-ec68-4788-a8b8-9d96b662321f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.455522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:02.456257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.456561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.456853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.493463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 742/1470] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:02.494455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.494749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.498534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.598541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] MFA Rules not processed for user `308cfa1f2c034e85960bd16b0953c39a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:02.601222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:02.640513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:02.642973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:02.682951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 729/1471] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:02.684612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:02.724064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588b71e-1f12-42fc-9e79-68e9db994e33 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.735202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:02.737483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.737835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.738426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] PATH_INFO: `/v3/projects/38461e55911e407bb19fd7df589795d2/users/3192ad9b19b84932807f3f1a48c9b52e/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.740965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38461e55911e407bb19fd7df589795d2, user_id=3192ad9b19b84932807f3f1a48c9b52e, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:02.744167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:02.758861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 730/1472] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:02 2022] PUT /identity/v3/projects/38461e55911e407bb19fd7df589795d2/users/3192ad9b19b84932807f3f1a48c9b52e/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:02.759896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:02.851765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 743/1473] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:02.852780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:02.881628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f4602-c8c4-442d-ab62-9708dbfb6760 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.910295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7752-28b2-41f0-a5e3-70062d1cd67f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:02.922606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6680c-df42-461d-b132-5a7da5f862f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:02.924734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6680c-df42-461d-b132-5a7da5f862f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.926685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6680c-df42-461d-b132-5a7da5f862f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.926685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6680c-df42-461d-b132-5a7da5f862f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:02.928422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6680c-df42-461d-b132-5a7da5f862f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:02.935440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6680c-df42-461d-b132-5a7da5f862f1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:02.950019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:02.966974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 731/1474] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:02.969224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:02.973353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:02.973913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.037332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.038672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.039026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.039376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.040374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:03.043483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:03.046868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] MFA Rules not processed for user `3192ad9b19b84932807f3f1a48c9b52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:03.048692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:03.062730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:03.080750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 744/1475] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:03.081740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:03.218528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd867efe-cd01-4522-8b1d-8d7140a27972 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:03.222632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.223661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.224076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.224448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.227136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:03.251238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 732/1476] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:03.252962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:03.283050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ae1ee-66fe-43d5-879c-72a665906366 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:03.290586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.292164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.292928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.293404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.294227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:03.296914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:03.380018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:03.381563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:03.382126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 733/1477] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:03 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:03.383155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:03.415625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 745/1478] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:03.416720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:03.450035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1114a-ed1d-4924-baeb-984ec4428a20 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:03.569543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141730a-7dc0-4949-8da5-1103ef88fdff admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:03.591178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.592627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.593016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.594007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] PATH_INFO: `/v3/projects/1ec1363aab4745839605f0d3c599429d/users/6f5b07fa625c45cf8baa2ce844014a75/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.631990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.633061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.634012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.636515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] PATH_INFO: `/v3/projects/caace1fba8634f239a037c138c829192/users/4bac7c7bc13d4f6c860b17125784fbab/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.641507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec1363aab4745839605f0d3c599429d, user_id=6f5b07fa625c45cf8baa2ce844014a75, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:03.647812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:03.673582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caace1fba8634f239a037c138c829192, user_id=4bac7c7bc13d4f6c860b17125784fbab, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:03.677415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 734/1479] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:03 2022] PUT /identity/v3/projects/1ec1363aab4745839605f0d3c599429d/users/6f5b07fa625c45cf8baa2ce844014a75/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:03.678393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:03.685932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:03.735713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 746/1480] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:03 2022] PUT /identity/v3/projects/caace1fba8634f239a037c138c829192/users/4bac7c7bc13d4f6c860b17125784fbab/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:03.736844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:03.820427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:03.830580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:03.831852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e1bad-0605-400a-9f1c-baf3f2818504 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:03.931470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c873f1-dbd3-4b91-a994-5208cf384806 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:03.971169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.972065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.972451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.972828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.977665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:03.978489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:03.981737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:03.982911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:03.984711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:03.991242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.057550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 747/1481] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:03 2022] POST /identity/v3/users => generated 297 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:04.058840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.102834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7b90-6a09-44ec-bca0-2bd188459db4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:04.109793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4694b9-87e9-4ac8-a62e-7209634ecad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:04.111003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4694b9-87e9-4ac8-a62e-7209634ecad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:04.111293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4694b9-87e9-4ac8-a62e-7209634ecad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:04.111614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4694b9-87e9-4ac8-a62e-7209634ecad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:04.112499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4694b9-87e9-4ac8-a62e-7209634ecad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:04.124408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4694b9-87e9-4ac8-a62e-7209634ecad3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.162038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 748/1482] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:04.163730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:04.164596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:04.165186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:04.192056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:04.196280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.213169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] MFA Rules not processed for user `4bac7c7bc13d4f6c860b17125784fbab`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:04.214612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:04.248408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 735/1483] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:04.249479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.293398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1abb7c-a3c3-460c-8370-8c6186a3ad57 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:04.309475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:04.314567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:04.316132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:04.318563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:04.320054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:04.324966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.377055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 736/1484] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:04.377055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.399840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d5807-427c-4bdf-ac62-bf1152f47ed7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:04.417092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 749/1485] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:04.418025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:04.418441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.418933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:04.419316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:04.419694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] PATH_INFO: `/v3/projects/1ec1363aab4745839605f0d3c599429d/users/6f5b07fa625c45cf8baa2ce844014a75/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:04.420807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:04.431096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec1363aab4745839605f0d3c599429d, user_id=6f5b07fa625c45cf8baa2ce844014a75, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:04.434027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.439685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78e319-feb0-4d91-ab5e-8359b5918735 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:04.447568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 737/1486] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:04 2022] PUT /identity/v3/projects/1ec1363aab4745839605f0d3c599429d/users/6f5b07fa625c45cf8baa2ce844014a75/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:04.448586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.528829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:04.529529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:04.529818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:04.530098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] PATH_INFO: `/v3/users/95c2a8d7192b48e49d9b98c2de1bab4c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:04.531360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c2a8d7192b48e49d9b98c2de1bab4c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:04.534053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.666263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c2a8d7192b48e49d9b98c2de1bab4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:04.667713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:04.679969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c2a8d7192b48e49d9b98c2de1bab4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:04.680704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c2a8d7192b48e49d9b98c2de1bab4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:04.688478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c2a8d7192b48e49d9b98c2de1bab4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:04.700063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c2a8d7192b48e49d9b98c2de1bab4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:04.701929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7697fa-cf4e-40b8-9ad3-b49c360eae32 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:04.720287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:04.721228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:04.721635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:04.722009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] PATH_INFO: `/v3/projects/d304a6ad19c94712a058e89f8180ead6/users/90a2515b07054103b9b2c2fc08207d3a/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:04.740221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 750/1487] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:04 2022] DELETE /identity/v3/users/95c2a8d7192b48e49d9b98c2de1bab4c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:04.741197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.742955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:04.775179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d304a6ad19c94712a058e89f8180ead6, user_id=90a2515b07054103b9b2c2fc08207d3a, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:04.778241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:04.831173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 738/1488] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:04 2022] PUT /identity/v3/projects/d304a6ad19c94712a058e89f8180ead6/users/90a2515b07054103b9b2c2fc08207d3a/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:04.833813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:04.837922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:04.862457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af728b13-6155-46cd-b83c-5dcfab99dd07 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:04.882043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:05.040667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:05.041466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.041761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.042036 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.048497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.055682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30b038-9e98-4d7b-969d-64c6fa177b81 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:05.068579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee58442-9941-44ce-953e-eba714ddbd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:05.072134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58442-9941-44ce-953e-eba714ddbd85 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.072425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58442-9941-44ce-953e-eba714ddbd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.072710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58442-9941-44ce-953e-eba714ddbd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.073365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee58442-9941-44ce-953e-eba714ddbd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:05.075305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee58442-9941-44ce-953e-eba714ddbd85 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:05.171586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 739/1489] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:04 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:05.171586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.171586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.171586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.202017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:05.203736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acefa56-dbad-41c5-8f25-35adc5162d42 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:05.242207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 751/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:05.242207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e2a1d-e439-460c-9f8c-99504968e688 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.242207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e2a1d-e439-460c-9f8c-99504968e688 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.243368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e2a1d-e439-460c-9f8c-99504968e688 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.248395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 752/1491] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:12:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:12:05.248587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] MFA Rules not processed for user `6f5b07fa625c45cf8baa2ce844014a75`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:05.248686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.248686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.248686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.257294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.293020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:05.294456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.357117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:05.424074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 753/1492] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:05.425033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:05.426469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.454642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2352e-e9a3-47e2-860d-58e9b5119e64 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:05.468725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 740/1493] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:05.469033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d95758-9546-4060-a7f6-cb354e65a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:05.469496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d95758-9546-4060-a7f6-cb354e65a8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.469663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:05.469826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d95758-9546-4060-a7f6-cb354e65a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.470075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d95758-9546-4060-a7f6-cb354e65a8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.470739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d95758-9546-4060-a7f6-cb354e65a8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:05.472754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d95758-9546-4060-a7f6-cb354e65a8f9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:05.493563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad3663-3f19-4c04-b07f-4e8490994c85 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:05.499821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 754/1494] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:05.501285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66986-0113-4603-98da-503181745422 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.501576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66986-0113-4603-98da-503181745422 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.501854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66986-0113-4603-98da-503181745422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.518839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:05.519623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.520498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.521915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.522661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:05.528491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:05.561407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f6e66986-0113-4603-98da-503181745422 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:05.564964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f6e66986-0113-4603-98da-503181745422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.574856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 741/1495] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:05 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:05.575822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:05.577661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.660385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c04513-0f09-4b53-aa40-e81de326598a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:05.664445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:05.665326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.665689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.665970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.678597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:05.680067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:05.694922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 742/1496] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:05.696058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:05.708251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108c3b-9c0c-4c6e-a615-e2ca52f2fdfe service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:05.713686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:05.714022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:05.714324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:05.714601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] PATH_INFO: `/v3/projects/d304a6ad19c94712a058e89f8180ead6/users/90a2515b07054103b9b2c2fc08207d3a/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:05.717435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d304a6ad19c94712a058e89f8180ead6, user_id=90a2515b07054103b9b2c2fc08207d3a, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:05.720996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:05.729415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:05.735975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 743/1497] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:05 2022] PUT /identity/v3/projects/d304a6ad19c94712a058e89f8180ead6/users/90a2515b07054103b9b2c2fc08207d3a/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:05.742369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:05.755530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:05.759337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 755/1498] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:12:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:05.760210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e66986-0113-4603-98da-503181745422 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:05.794384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e66986-0113-4603-98da-503181745422 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:06.012168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0949241-f1bb-4912-a00c-06d48cc98f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:06.014810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949241-f1bb-4912-a00c-06d48cc98f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.015967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949241-f1bb-4912-a00c-06d48cc98f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.016704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0949241-f1bb-4912-a00c-06d48cc98f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.019028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949241-f1bb-4912-a00c-06d48cc98f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:06.027828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0949241-f1bb-4912-a00c-06d48cc98f3f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:06.059633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 756/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:06.062388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.062388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.062581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.158930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b38df-8faf-43a3-958d-9c20b5a57910 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:06.166122 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] MFA Rules not processed for user `90a2515b07054103b9b2c2fc08207d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:06.167246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:06.167513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:06.170484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.170771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.171361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.285578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:06.357612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:06.366585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 757/1500] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:06.366585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:06.372078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:06.373042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:06.415556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 744/1501] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:06.421030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:06.465579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962db56-e4e4-4689-9354-fb6628a20685 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:06.496713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:06.497406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.497687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.497963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] PATH_INFO: `/v3/projects/1842f1c0bb5247c2854134ae79d622e3/users/de408f76f5d749558458d545a280b3f2/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.552830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd3e78-31ef-4acb-868e-fafaed0fa3ce None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:06.560057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1842f1c0bb5247c2854134ae79d622e3, user_id=de408f76f5d749558458d545a280b3f2, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:06.568271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:06.568439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:06.571296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.571942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.583907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.599702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:06.610524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:06.618489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 745/1502] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:06 2022] PUT /identity/v3/projects/1842f1c0bb5247c2854134ae79d622e3/users/de408f76f5d749558458d545a280b3f2/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:06.618489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:06.651860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 758/1503] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:06.653877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:06.679503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e478f-76a4-49c9-8b88-5743c2ef7de6 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:06.816436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16f4da6-d899-4363-8634-09f1cb52e84e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:06.826866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:06.827526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.827807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.828175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.861399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:06.865305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:06.867746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:06.871665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:06.876810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:06.920907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:06.977826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:06.980432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:07.012342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 746/1504] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:07.012342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:07.058730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:07.060228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dec200-5763-4160-b01b-3bd936c8b6d9 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:07.093917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 759/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:07.095139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe44ef-e579-445a-b65e-b849ccc917b7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:07.095426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe44ef-e579-445a-b65e-b849ccc917b7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:07.095704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe44ef-e579-445a-b65e-b849ccc917b7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:07.097279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 760/1506] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:12:07.102256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:07.102778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:07.102778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:07.142844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:07.144196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:07.175716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:07.239817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a777b1-8211-4e46-9d61-a115f6d3c471 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:07.271743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40cc0-ebc8-4ad9-ad45-7668a84e8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:07.272575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40cc0-ebc8-4ad9-ad45-7668a84e8020 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:07.272844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40cc0-ebc8-4ad9-ad45-7668a84e8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:07.273116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40cc0-ebc8-4ad9-ad45-7668a84e8020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:07.274045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40cc0-ebc8-4ad9-ad45-7668a84e8020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:07.275670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40cc0-ebc8-4ad9-ad45-7668a84e8020 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:07.321446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 761/1507] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:07.343100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 747/1508] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:07.346010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:07.367572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74301a0d-d94a-46f3-9c2f-ee4cfbf6e30b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:07.382129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:07.382930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:07.385060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:07.386270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] PATH_INFO: `/v3/projects/1842f1c0bb5247c2854134ae79d622e3/users/de408f76f5d749558458d545a280b3f2/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:07.393076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1842f1c0bb5247c2854134ae79d622e3, user_id=de408f76f5d749558458d545a280b3f2, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:07.416253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:07.481777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 762/1509] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:07 2022] PUT /identity/v3/projects/1842f1c0bb5247c2854134ae79d622e3/users/de408f76f5d749558458d545a280b3f2/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:07.487911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:07.488115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:07.488668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:07.569709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] MFA Rules not processed for user `de408f76f5d749558458d545a280b3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:07.573277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:07.802352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:07.804420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:07.861470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 748/1510] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:07.974176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:07.985204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c6f61-cf7c-4758-bbf1-91a9343aa27a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:08.004057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:08.004802 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:08.005153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:08.005632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:08.026896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:08.034059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:08.058322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 763/1511] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:08.130251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bdd26-e892-4cf1-90d8-6b81ae1ed15e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:08.142105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:08.142801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:08.143066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:08.143509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:08.159098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:08.169811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:08.189676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:08.226059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 749/1512] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:08.305716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:08.307697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:08.548805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b765fe-5414-47ff-adb2-19c704f68312 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:08.566747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:08.567406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:08.567684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:08.567978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] PATH_INFO: `/v3/projects/69e94ec58a0349eea76e7fecccd5655a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:08.572750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e94ec58a0349eea76e7fecccd5655a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:08.574893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:08.605821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:08.635752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:08.742018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e94ec58a0349eea76e7fecccd5655a', 'request_id': 'req-35100a85-608b-4db2-b42e-7c1bf1168626'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:08.761609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e94ec58a0349eea76e7fecccd5655a', 'request_id': 'req-35100a85-608b-4db2-b42e-7c1bf1168626'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:08.783994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e94ec58a0349eea76e7fecccd5655a', 'request_id': 'req-35100a85-608b-4db2-b42e-7c1bf1168626'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:08.797779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639779a-bb39-4f04-9c3e-6d38841da2d4 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:08.805508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] The token cache is being invalidate because project 69e94ec58a0349eea76e7fecccd5655a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:08.808866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:08.811181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:08.816048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 764/1513] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:08 2022] DELETE /identity/v3/projects/69e94ec58a0349eea76e7fecccd5655a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:08.817090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:08.822188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:08.949191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35100a85-608b-4db2-b42e-7c1bf1168626 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:08.962742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:08.963841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:08.964261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:08.964694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:08.970293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90a2515b07054103b9b2c2fc08207d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd304a6ad19c94712a058e89f8180ead6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:08.971402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:08.973891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:08.974238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:08.975326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:08.976412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:08.976733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:08.979627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:09.023514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 750/1514] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:12:09.025380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:09.030704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:09.152104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133fe07-35d1-47b1-9e65-d6943fc5368d tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:09.153820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:09.155908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:09.161906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:09.162751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:09.163119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:09.163307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] PATH_INFO: `/v3/users/2acd5551839a434ca218e47dffa36923` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:09.165488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acd5551839a434ca218e47dffa36923)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:09.167394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:09.224612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 765/1515] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:09.225939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:09.234370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:09.245813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:09.268160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acd5551839a434ca218e47dffa36923'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:09.280796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acd5551839a434ca218e47dffa36923'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:09.282634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acd5551839a434ca218e47dffa36923'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:09.284395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acd5551839a434ca218e47dffa36923'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:09.289667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa52fe-3dd1-4329-8008-c176c8135abd service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:09.300389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acd5551839a434ca218e47dffa36923'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:09.312277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90a2515b07054103b9b2c2fc08207d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd304a6ad19c94712a058e89f8180ead6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:09.314172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:09.317508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:09.318483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:09.320780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:09.323000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:09.341577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 751/1516] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:09 2022] DELETE /identity/v3/users/2acd5551839a434ca218e47dffa36923 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:09.404296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 766/1517] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:09 2022] POST /identity/v3/projects => generated 353 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:09.408898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:09.410628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:09.595662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111e7b7-ddae-481b-891b-36fc4c37dc78 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:09.751208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90a2515b07054103b9b2c2fc08207d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd304a6ad19c94712a058e89f8180ead6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:09.751841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:09.757734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:09.758084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:09.764718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:09.765087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:09.767751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:09.800033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 752/1518] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:10.209070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:10.211791 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:10.328363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:10.374026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264b35-5da2-4cda-b3dd-6ecca47a8568 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:10.386335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:10.388582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:10.388920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:10.389141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] PATH_INFO: `/v3/projects/460b60cb0b684c20aa4f5ee4effbb3b6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:10.391141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=460b60cb0b684c20aa4f5ee4effbb3b6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:10.395788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:10.504953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460b60cb0b684c20aa4f5ee4effbb3b6', 'request_id': 'req-a46753da-08e0-49b7-b47e-d96cd7192e5b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.518893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460b60cb0b684c20aa4f5ee4effbb3b6', 'request_id': 'req-a46753da-08e0-49b7-b47e-d96cd7192e5b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.536088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:10.536422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460b60cb0b684c20aa4f5ee4effbb3b6', 'request_id': 'req-a46753da-08e0-49b7-b47e-d96cd7192e5b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.555080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bac3-9ffe-4f8f-a7c2-58f5b017d742 tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:10.558785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] The token cache is being invalidate because project 460b60cb0b684c20aa4f5ee4effbb3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:10.559169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.560045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a46753da-08e0-49b7-b47e-d96cd7192e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.563497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 767/1519] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:10 2022] DELETE /identity/v3/projects/460b60cb0b684c20aa4f5ee4effbb3b6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:10.572580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a773-30af-479a-948b-214dba911bda None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:10.573067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a773-30af-479a-948b-214dba911bda None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:10.573354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77a773-30af-479a-948b-214dba911bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:10.603899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7c77a773-30af-479a-948b-214dba911bda None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:10.605314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7c77a773-30af-479a-948b-214dba911bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:10.728914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 768/1520] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:10.730637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:10.735610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:10.737538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:10.741032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:10.748178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90a2515b07054103b9b2c2fc08207d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd304a6ad19c94712a058e89f8180ead6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:10.748839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:10.752301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:10.752912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] PATH_INFO: `/v3/projects/541121ac3cd94878ab865f89a663a67c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:10.760260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorizing `identity:delete_project(project_id=541121ac3cd94878ab865f89a663a67c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:10.762784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:10.796075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:10.800135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:10.844524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 769/1521] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:10.845455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:10.875924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541121ac3cd94878ab865f89a663a67c', 'request_id': 'req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.890054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541121ac3cd94878ab865f89a663a67c', 'request_id': 'req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.894497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41a07d-82f4-4952-94a2-4ba6a6df8d84 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:10.903014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541121ac3cd94878ab865f89a663a67c', 'request_id': 'req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.950466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] The token cache is being invalidate because project 541121ac3cd94878ab865f89a663a67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:10.950466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.951550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:10.967373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 753/1522] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:10 2022] DELETE /identity/v3/projects/541121ac3cd94878ab865f89a663a67c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:11.042776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.043718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.044179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.044469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.047092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:11.047443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.051602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.081428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 770/1523] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:11.085584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.088423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:11.116270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a09cc-8ac3-4ee6-988c-d9ef169a8d4e tempest-VolumeQuotaClassesTest-1792082656 tempest-VolumeQuotaClassesTest-1792082656-project-admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.142978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.143774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.144204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.144543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.145349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.147570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.194022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 754/1524] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:11 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:11.195552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.205621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:11.213975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b880c-1330-4814-9ba4-a546eefec06c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.328945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.329635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.329883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.330295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.331185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.334991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.393285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 771/1525] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:11 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:11.394939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.415731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692de997-f02e-4895-8733-432e541c06ad admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.438695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.438695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.438695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.438695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.439012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.440090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.465824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 755/1526] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:11.470267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.488640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298a7dc-591a-4fcc-ac42-68839b62b623 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.494957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91d392-e17a-4eb8-83a2-2e4ffba724ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.495813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d392-e17a-4eb8-83a2-2e4ffba724ff admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.496252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d392-e17a-4eb8-83a2-2e4ffba724ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.496541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91d392-e17a-4eb8-83a2-2e4ffba724ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.497305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d392-e17a-4eb8-83a2-2e4ffba724ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.498999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91d392-e17a-4eb8-83a2-2e4ffba724ff admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.526881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 772/1527] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:11.529026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.544464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0bc5-0bcc-4480-8828-5cf28d6155db admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.550829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.551860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.552229 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.552677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] PATH_INFO: `/v3/projects/8dc458d683934588942bd3edaeb3f7bc/users/a97b49b42fdf4fcc8d4cf94f52f33110/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.572001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc458d683934588942bd3edaeb3f7bc, user_id=a97b49b42fdf4fcc8d4cf94f52f33110, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.575369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.589855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 756/1528] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:11 2022] PUT /identity/v3/projects/8dc458d683934588942bd3edaeb3f7bc/users/a97b49b42fdf4fcc8d4cf94f52f33110/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:11.601479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849273-971d-4df1-8abd-18888ef88530 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.602196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849273-971d-4df1-8abd-18888ef88530 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.602556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44849273-971d-4df1-8abd-18888ef88530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.645838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-44849273-971d-4df1-8abd-18888ef88530 None None] MFA Rules not processed for user `a97b49b42fdf4fcc8d4cf94f52f33110`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:11.648095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-44849273-971d-4df1-8abd-18888ef88530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:11.749402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 773/1529] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:11.754712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.789879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849273-971d-4df1-8abd-18888ef88530 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.791860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-44849273-971d-4df1-8abd-18888ef88530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:11.869432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb65cb-ad7e-4de7-8ecf-0e6324e294a8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.877467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.879159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.879449 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.879723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.880645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.884055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.897966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44849273-971d-4df1-8abd-18888ef88530 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:11.904160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:11.905349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:11.905784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:11.906736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] PATH_INFO: `/v3/users/308cfa1f2c034e85960bd16b0953c39a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:11.908260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] RBAC: Authorizing `identity:delete_user(user_id=308cfa1f2c034e85960bd16b0953c39a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:11.911127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:11.939207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:11.944069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 757/1530] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:11 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:11.945890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:11.979400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:12.008132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308cfa1f2c034e85960bd16b0953c39a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.019152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308cfa1f2c034e85960bd16b0953c39a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.020447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308cfa1f2c034e85960bd16b0953c39a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.021217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308cfa1f2c034e85960bd16b0953c39a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.034093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81fef064-0f72-41ed-88d2-434664f5802b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308cfa1f2c034e85960bd16b0953c39a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.049925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8df57-de03-46c7-8223-74ad3a9a9379 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.056527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.057567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.057857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.058134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.058778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.060817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.064026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 774/1531] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:11 2022] DELETE /identity/v3/users/308cfa1f2c034e85960bd16b0953c39a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:12.065531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.065724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.066006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.094672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:12.095944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.100019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 758/1532] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:11 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:12.101118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.103004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.124976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989ed6f-df3b-4f78-8917-fb9f68d23b75 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.185733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 775/1533] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:12.196548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.198071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.240333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.240970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.241249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.241514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.242163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.243772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.270658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 759/1534] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:12.273103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.285158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12270f7-b3c5-44bc-b576-4d8780f206be admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.290455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.291139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.291593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.291899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] PATH_INFO: `/v3/projects/8090632e3f224d9ea17986a002add8ea/users/6de9c7b3de5e4c5bb1c364777fa0efdd/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.315720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8090632e3f224d9ea17986a002add8ea, user_id=6de9c7b3de5e4c5bb1c364777fa0efdd, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.318755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.325407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7922b2-4b6e-49f3-98c1-c0316ab57a7c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.329801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.330737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.330991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.331271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.344818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.346352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.357074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 760/1535] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:12 2022] PUT /identity/v3/projects/8090632e3f224d9ea17986a002add8ea/users/6de9c7b3de5e4c5bb1c364777fa0efdd/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:12.360562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 776/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:12.361753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.470230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ecc82e-033f-4b4c-b18d-d5d80319b3d8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.477594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6635896-c5bd-4bf8-b7c3-597380064557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.478496 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6635896-c5bd-4bf8-b7c3-597380064557 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.478876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6635896-c5bd-4bf8-b7c3-597380064557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.479157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6635896-c5bd-4bf8-b7c3-597380064557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.479845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6635896-c5bd-4bf8-b7c3-597380064557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.482207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6635896-c5bd-4bf8-b7c3-597380064557 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.495937 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 761/1537] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:12.499014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.510712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21d3dc-5724-4019-b3e5-e827ec98b1c6 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.515745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.516631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.516909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.517181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] PATH_INFO: `/v3/projects/8090632e3f224d9ea17986a002add8ea/users/6de9c7b3de5e4c5bb1c364777fa0efdd/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.519231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8090632e3f224d9ea17986a002add8ea, user_id=6de9c7b3de5e4c5bb1c364777fa0efdd, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.521959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.536209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 777/1538] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:12 2022] PUT /identity/v3/projects/8090632e3f224d9ea17986a002add8ea/users/6de9c7b3de5e4c5bb1c364777fa0efdd/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:12.547358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.547650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.548006 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.571009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:12.589612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] MFA Rules not processed for user `6de9c7b3de5e4c5bb1c364777fa0efdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:12.596086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.679455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 762/1539] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:12.687823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.691218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.739544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:12.789316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.790624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf16eb4-5df9-49ea-9e9a-2ae7d7127c6b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.791441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.804564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.806052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.806052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.806052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.819172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.822228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.835838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 778/1540] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:12.883747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6aebb-3e86-40a8-8ccd-19eeeb3436f2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.892310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:12.892310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:12.892310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:12.892310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] PATH_INFO: `/v3/projects/3b4b75ced2244dcea6999dc96ed170d2` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:12.892773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4b75ced2244dcea6999dc96ed170d2)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:12.893649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:12.925310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.935892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac5d63-afc9-4748-8e5a-fcb3bd6e2ca6 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:12.955045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4b75ced2244dcea6999dc96ed170d2', 'request_id': 'req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.965335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4b75ced2244dcea6999dc96ed170d2', 'request_id': 'req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.974284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4b75ced2244dcea6999dc96ed170d2', 'request_id': 'req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.986364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] The token cache is being invalidate because project 3b4b75ced2244dcea6999dc96ed170d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:12.986750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.987470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:12.989512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 763/1541] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:12 2022] DELETE /identity/v3/projects/3b4b75ced2244dcea6999dc96ed170d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:12.993278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:12.994922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:12.999042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:13.000948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.001227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.001500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:13.009613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:13.032856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:13.075276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f30ee0-1c75-4d83-b620-5a2a6fd50b86 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:13.081104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:13.081765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.082049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.082391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] PATH_INFO: `/v3/users/90a2515b07054103b9b2c2fc08207d3a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:13.083410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:13.083524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a2515b07054103b9b2c2fc08207d3a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:13.085165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:13.086564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:13.096838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 779/1542] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:13.097715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:13.099148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:13.122617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9016d5-a17b-4c54-81da-6150cac4e7ba service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:13.129375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:13.130022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.130352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.130629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] PATH_INFO: `/v3/users/d4aa6dd99f40485db19f34bcf3662dac` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:13.131793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4aa6dd99f40485db19f34bcf3662dac)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:13.137262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:13.172660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a2515b07054103b9b2c2fc08207d3a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.183155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a2515b07054103b9b2c2fc08207d3a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.184221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a2515b07054103b9b2c2fc08207d3a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.184879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a2515b07054103b9b2c2fc08207d3a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.194576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-816547da-f103-44cf-8474-f4a6eb6f209e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a2515b07054103b9b2c2fc08207d3a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.200114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4aa6dd99f40485db19f34bcf3662dac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.211325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4aa6dd99f40485db19f34bcf3662dac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.212724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4aa6dd99f40485db19f34bcf3662dac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.213599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4aa6dd99f40485db19f34bcf3662dac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.224115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 764/1543] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:12 2022] DELETE /identity/v3/users/90a2515b07054103b9b2c2fc08207d3a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:13.224371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4aa6dd99f40485db19f34bcf3662dac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.241022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:13.269788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.270079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.270363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:13.274408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 780/1544] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:13 2022] DELETE /identity/v3/users/d4aa6dd99f40485db19f34bcf3662dac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:13.299838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:13.301857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:13.395968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 765/1545] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:13.405946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:13.408089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:13.519457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885aee-afb7-4d28-9b0b-c9fae2f1f19c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:13.532284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a762b-1ca8-47f3-9d8c-fc7788cbd574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:13.532916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a762b-1ca8-47f3-9d8c-fc7788cbd574 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.533195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a762b-1ca8-47f3-9d8c-fc7788cbd574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.533463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a762b-1ca8-47f3-9d8c-fc7788cbd574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:13.550839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a762b-1ca8-47f3-9d8c-fc7788cbd574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:13.552812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a762b-1ca8-47f3-9d8c-fc7788cbd574 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:13.564420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 781/1546] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:13.744907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:13.746841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:13.770276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0817f-a7a0-4c4a-a78e-b3b6734812ea None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:13.782992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:13.784153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.785565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.786598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] PATH_INFO: `/v3/projects/d304a6ad19c94712a058e89f8180ead6` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:13.795302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d304a6ad19c94712a058e89f8180ead6)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:13.798477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:13.890140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:13.908739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd304a6ad19c94712a058e89f8180ead6', 'request_id': 'req-f6d04ec1-2803-4788-a43d-c4f44ebab09c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.920389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd304a6ad19c94712a058e89f8180ead6', 'request_id': 'req-f6d04ec1-2803-4788-a43d-c4f44ebab09c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.931584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd304a6ad19c94712a058e89f8180ead6', 'request_id': 'req-f6d04ec1-2803-4788-a43d-c4f44ebab09c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.971627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] The token cache is being invalidate because project d304a6ad19c94712a058e89f8180ead6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:13.971951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.975592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f6d04ec1-2803-4788-a43d-c4f44ebab09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:13.978563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 766/1547] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:13 2022] DELETE /identity/v3/projects/d304a6ad19c94712a058e89f8180ead6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:13.984163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:13.984590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:13.993018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.047319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:14.048559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.121510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 782/1548] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:14.132045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.132535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.133530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.158403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:14.159864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.174149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.174791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 767/1549] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:14.184789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b4fa-8f56-4c56-98b1-5535ab875b58 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.189926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.190541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.190842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.191094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.191755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:14.192091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.193895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.206930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 783/1550] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:14.209129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.210734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.210916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.223789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9974b-4b03-4e04-aade-43c47504ede6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.229839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.230642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.231065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.231411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba944bb-d649-4e62-87c5-0878cafd7474 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.231804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.232667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.235605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.237769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.240217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.240217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.240509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] PATH_INFO: `/v3/projects/073cbcebe9f64a00846672e24948ff3b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.241881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073cbcebe9f64a00846672e24948ff3b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.244779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.287702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 784/1551] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:14 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:14.292363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.299107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073cbcebe9f64a00846672e24948ff3b', 'request_id': 'req-0c31f45a-570c-4a1c-9def-474d02d55c03'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.307300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073cbcebe9f64a00846672e24948ff3b', 'request_id': 'req-0c31f45a-570c-4a1c-9def-474d02d55c03'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.314245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073cbcebe9f64a00846672e24948ff3b', 'request_id': 'req-0c31f45a-570c-4a1c-9def-474d02d55c03'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.325241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] The token cache is being invalidate because project 073cbcebe9f64a00846672e24948ff3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:14.325530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.326212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.327734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 768/1552] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:14 2022] DELETE /identity/v3/projects/073cbcebe9f64a00846672e24948ff3b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:14.332341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.333815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.356179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:14.360794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4b6cd-b017-4f21-8d6e-f247aa416697 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.367513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.368408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.368909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.369496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.370687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.373357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.396759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 785/1553] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:14 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:14.400755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.402363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.413490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31f45a-570c-4a1c-9def-474d02d55c03 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.415195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730aff9-15fb-42b5-9fda-3f15cde9cba6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.418767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.419428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.419771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.420082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] PATH_INFO: `/v3/users/3192ad9b19b84932807f3f1a48c9b52e` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.420552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.421148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.421241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3192ad9b19b84932807f3f1a48c9b52e)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.421433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.421833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.423024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.423893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.424649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.434624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 786/1554] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:14.439050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.449497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d0272-2c1d-44e4-8248-10da2bbfda31 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.454822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.455639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.456086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.456362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.457081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.458781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.470549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 787/1555] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:14.474641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.477018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3192ad9b19b84932807f3f1a48c9b52e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.478386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:14.485712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9453eab-a111-45de-8949-879d3f5a1386 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.488728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3192ad9b19b84932807f3f1a48c9b52e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.489677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3192ad9b19b84932807f3f1a48c9b52e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.490530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3192ad9b19b84932807f3f1a48c9b52e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.491561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.492235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.492514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.492787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] PATH_INFO: `/v3/projects/5567d94cf3a34f27a677d0a5c674fb32/users/70f1eab02a1f4212814222b0b04a4d7d/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.498566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9deb76c9-610e-4491-848b-ebbfd54da657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3192ad9b19b84932807f3f1a48c9b52e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:14.509738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5567d94cf3a34f27a677d0a5c674fb32, user_id=70f1eab02a1f4212814222b0b04a4d7d, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.512612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.524065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 769/1556] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:14 2022] DELETE /identity/v3/users/3192ad9b19b84932807f3f1a48c9b52e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:14.526404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 788/1557] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:14 2022] PUT /identity/v3/projects/5567d94cf3a34f27a677d0a5c674fb32/users/70f1eab02a1f4212814222b0b04a4d7d/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:14.536514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.536856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.537136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.566185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] MFA Rules not processed for user `70f1eab02a1f4212814222b0b04a4d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:14.567434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.643801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 770/1558] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:14.646224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.648627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.740156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9845e1-bb49-4e4c-bcc3-1de24a4edf69 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.819691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.821732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.822158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.822574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.823344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:14.826282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:14.865554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 789/1559] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:14 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:14.866868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.874412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:14.877448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:14.879167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64dbf9-c181-4576-baea-31298a64ba68 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.940924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:14.990010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2520f5-6d03-4ddd-b773-4341de434d11 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:14.996158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:14.997012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:14.997296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:14.997716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] PATH_INFO: `/v3/projects/38461e55911e407bb19fd7df589795d2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:14.999122 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38461e55911e407bb19fd7df589795d2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.003084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.003418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.004282 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.004841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.005267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.006126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.008330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.036266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 771/1560] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:14 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:15.039847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.052075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75683f2-3caa-436b-a51c-e21b63ecb991 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.072629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.073474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.073791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.074400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.076072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.077822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.090454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38461e55911e407bb19fd7df589795d2', 'request_id': 'req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.103410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38461e55911e407bb19fd7df589795d2', 'request_id': 'req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.114680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 772/1561] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:15.118687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.119096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38461e55911e407bb19fd7df589795d2', 'request_id': 'req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.142107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b905d-d4b9-460f-97f4-48c9f12847bb admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.143770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] The token cache is being invalidate because project 38461e55911e407bb19fd7df589795d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:15.144119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.147604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-731fd9a2-2863-4af2-b7ad-8adcc3c5ed16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.154374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 790/1562] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:14 2022] DELETE /identity/v3/projects/38461e55911e407bb19fd7df589795d2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:15.155919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315d3e-d3b7-4ec6-aba5-07f28e01d79e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.156206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315d3e-d3b7-4ec6-aba5-07f28e01d79e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.157038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315d3e-d3b7-4ec6-aba5-07f28e01d79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.205979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:15.207186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dc315d3e-d3b7-4ec6-aba5-07f28e01d79e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:15.210844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dc315d3e-d3b7-4ec6-aba5-07f28e01d79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.247986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.248922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.249666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.250454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.251751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.253852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.269879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 773/1563] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:15.275053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.281655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.303785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204724e7-867e-4bc9-9215-b8465553a747 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.315031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e9736-4e57-4142-ad79-27b1370f7cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.315844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e9736-4e57-4142-ad79-27b1370f7cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.316142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e9736-4e57-4142-ad79-27b1370f7cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.316422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e9736-4e57-4142-ad79-27b1370f7cb0 admin admin] PATH_INFO: `/v3/projects/58c07a2f5c7c4e9dbbf326fe26bed540/users/89e0ae785da94b6f834dba6000abe5ac/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.341946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 791/1564] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:15.347163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.347537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.347794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.380238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e9736-4e57-4142-ad79-27b1370f7cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c07a2f5c7c4e9dbbf326fe26bed540, user_id=89e0ae785da94b6f834dba6000abe5ac, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.382916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e9736-4e57-4142-ad79-27b1370f7cb0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.386147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:15.388877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.414952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 792/1565] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:15.416022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.419233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 774/1566] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:15 2022] PUT /identity/v3/projects/58c07a2f5c7c4e9dbbf326fe26bed540/users/89e0ae785da94b6f834dba6000abe5ac/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:15.434810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daafa39-c688-42fb-ae67-129b938d4e44 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.438962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.439208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.439485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.510767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] MFA Rules not processed for user `89e0ae785da94b6f834dba6000abe5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:15.513896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.542956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:15.562263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.563528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.564349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.564697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.565478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:15.565891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.567950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.593051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 793/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:15.594729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.608814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a365d-0765-486e-ac7e-5237408add2a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.616846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.617500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.618060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.618312 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.619382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.621676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.653349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 775/1568] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:15.659755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.667828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 794/1569] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:15.669639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.674139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc68dff-e0d5-4df3-aec9-5e8f8b990b24 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.776514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccff65-4f03-4985-b988-411ecd7b64a6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.781655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.782386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.782789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.783073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.784432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.784559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.790736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.790845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.790845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.790845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.790845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.791739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.816925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 795/1570] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:15.819551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.825162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.844090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c745-ea58-41c6-86fd-18a9130b3fb5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.849011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 776/1571] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:15.850228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.850751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.851401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.851685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.852033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] PATH_INFO: `/v3/users/4bac7c7bc13d4f6c860b17125784fbab` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.853188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bac7c7bc13d4f6c860b17125784fbab)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.855130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.879175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:15.917983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bac7c7bc13d4f6c860b17125784fbab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.926310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bac7c7bc13d4f6c860b17125784fbab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.927058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bac7c7bc13d4f6c860b17125784fbab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.927836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bac7c7bc13d4f6c860b17125784fbab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.928155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d51619-1af4-48d5-8026-ffd2564ed52f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:15.932893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:15.933515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:15.933867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:15.934153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:15.934980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:15.936866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:15.937609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bac7c7bc13d4f6c860b17125784fbab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:15.954614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 777/1572] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:15.955547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.960849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 796/1573] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:15 2022] DELETE /identity/v3/users/4bac7c7bc13d4f6c860b17125784fbab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:15.964756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:15.964865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.966577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:15.978011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5431fb-c1cc-48e6-a4e6-7eb844ecd861 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.010895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:16.053545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711cc2-6d21-4346-a500-3b63e0624cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.054336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711cc2-6d21-4346-a500-3b63e0624cde admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.054721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711cc2-6d21-4346-a500-3b63e0624cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.055082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711cc2-6d21-4346-a500-3b63e0624cde admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.056017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711cc2-6d21-4346-a500-3b63e0624cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.058605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711cc2-6d21-4346-a500-3b63e0624cde admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.063428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff21e4-fb1f-4cc5-bba2-408f45468a17 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.071245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.073291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.073574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.073844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.074554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.076486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.087365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 778/1574] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:15 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:16.089319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.089876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.091746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.094679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 797/1575] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:16.095732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.110020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447c4d-a999-4270-b4c4-7cb83e041f04 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.116374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.116998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.117279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.117551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.118193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.119791 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.120215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:16.122578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:16.132750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 798/1576] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:16.133146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 779/1577] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:16.136837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.138260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.155386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f6d5-748c-4cf9-88e5-62173218a311 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.156315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edb6b4-0251-405c-8570-7ba408d8943e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.161506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.162637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.163145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.163600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] PATH_INFO: `/v3/projects/7c1072c0a1d64640901be54698b68289/users/2a9051d5c0e24de7aba2c7057fcae6e4/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.164383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.165261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.165699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.166046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] PATH_INFO: `/v3/projects/d6c2e7caf1fd458aa24ec1e031c39dd2/users/a348ca891f234ad099b12c252472a582/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.186213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1072c0a1d64640901be54698b68289, user_id=2a9051d5c0e24de7aba2c7057fcae6e4, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.190002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.192522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c2e7caf1fd458aa24ec1e031c39dd2, user_id=a348ca891f234ad099b12c252472a582, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.195307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.221889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 780/1578] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:16 2022] PUT /identity/v3/projects/7c1072c0a1d64640901be54698b68289/users/2a9051d5c0e24de7aba2c7057fcae6e4/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:16.225215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 799/1579] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:16 2022] PUT /identity/v3/projects/d6c2e7caf1fd458aa24ec1e031c39dd2/users/a348ca891f234ad099b12c252472a582/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:16.225325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.227648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:16.235297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.291893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ef27-e761-4955-a02a-218f4df1954d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.299492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be48c4c-6e2b-4838-8d40-513323ea5db3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.304458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35958f17-ae42-4843-bed5-bf175f563864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.305193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958f17-ae42-4843-bed5-bf175f563864 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.305477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958f17-ae42-4843-bed5-bf175f563864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.305750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35958f17-ae42-4843-bed5-bf175f563864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.306433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35958f17-ae42-4843-bed5-bf175f563864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.308130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35958f17-ae42-4843-bed5-bf175f563864 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.318067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 800/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:16.319382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.319670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.320528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:16.320634 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.347097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.347743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.348072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.348343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.358429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] MFA Rules not processed for user `a348ca891f234ad099b12c252472a582`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:16.359738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:16.360935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.362762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.386608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 781/1581] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:16.387588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.412520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec993f8f-9bcc-46c1-b664-36aae0da4273 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.421688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a79c5-f5d7-4e28-9329-0bb6e9a6e02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.422428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a79c5-f5d7-4e28-9329-0bb6e9a6e02f admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.422705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a79c5-f5d7-4e28-9329-0bb6e9a6e02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.422979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a79c5-f5d7-4e28-9329-0bb6e9a6e02f admin admin] PATH_INFO: `/v3/projects/7c1072c0a1d64640901be54698b68289/users/2a9051d5c0e24de7aba2c7057fcae6e4/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.425769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a79c5-f5d7-4e28-9329-0bb6e9a6e02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1072c0a1d64640901be54698b68289, user_id=2a9051d5c0e24de7aba2c7057fcae6e4, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.428998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a79c5-f5d7-4e28-9329-0bb6e9a6e02f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.447451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 782/1582] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:16 2022] PUT /identity/v3/projects/7c1072c0a1d64640901be54698b68289/users/2a9051d5c0e24de7aba2c7057fcae6e4/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:16.459525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.460005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.460802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.480693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 801/1583] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:16.481815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.500397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49523d58-562b-46a1-b995-01e80d93e678 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.535971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:16.536108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] MFA Rules not processed for user `2a9051d5c0e24de7aba2c7057fcae6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:16.537754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:16.671200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.672422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.672713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.672988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.673118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 783/1584] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:16.673642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.675575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.689059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.692091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:16.806964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 802/1585] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:16 2022] POST /identity/v3/projects => generated 383 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:16.810819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:16.844940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c73001-8a97-4320-a42e-0f3e829a947b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.900813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.901978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba02def-df47-486b-9825-5bd98e4b2bca admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:16.902438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.902863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.903273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.907575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:16.908571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:16.908934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:16.909278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:16.909988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.912339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:16.919568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:16.982749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:16.984922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.010644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 784/1586] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:17.012536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.016180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.021462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 803/1587] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:16 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:17.025915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.042713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c891a3-3bd9-4754-aacd-c1b31e2cb2c0 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.049276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.049932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.050220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.050684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] PATH_INFO: `/v3/projects/caace1fba8634f239a037c138c829192` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.052148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caace1fba8634f239a037c138c829192)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.057946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed1e6a-e700-4fa2-9b12-6857c6a8530c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.062853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.070492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.071579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.071864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.072684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.075919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.078661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.096141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 804/1588] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:17.099647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.112515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243486e1-3e1a-4aa3-b7fc-4836da358da4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.122151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.123165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.124201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.124563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] PATH_INFO: `/v3/projects/cc9cc23e6ba14ca59a3a1f1294fb59ac/users/43f26d74d69b4f1a87523b8a25e1e611/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.140174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caace1fba8634f239a037c138c829192', 'request_id': 'req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.150248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caace1fba8634f239a037c138c829192', 'request_id': 'req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.153047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9cc23e6ba14ca59a3a1f1294fb59ac, user_id=43f26d74d69b4f1a87523b8a25e1e611, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.155989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.159006 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caace1fba8634f239a037c138c829192', 'request_id': 'req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.172150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 805/1589] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:17 2022] PUT /identity/v3/projects/cc9cc23e6ba14ca59a3a1f1294fb59ac/users/43f26d74d69b4f1a87523b8a25e1e611/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:17.172705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] The token cache is being invalidate because project caace1fba8634f239a037c138c829192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:17.173208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.174087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.175855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.176289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 785/1590] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:17 2022] DELETE /identity/v3/projects/caace1fba8634f239a037c138c829192 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:17.177253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.177755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.179270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.257838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289e129-f81e-4dea-9781-5fb079e03308 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.268772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.268772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.268772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.268772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.274303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.282871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e3f0d-22a4-4c63-8c7f-e0bfe2234f01 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.300491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:17.346727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:17.370834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.372312 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.372453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.373263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.373551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.373831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.374487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.377251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.383526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 806/1591] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:17.384511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.386123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.392062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 786/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:17.395708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.408207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124b228-e338-4076-bfc8-cb4b9c3e8f7f service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.409147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9ec6f-c5ae-48e2-a196-997538f872aa admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.415721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.416420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.416787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.417246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] PATH_INFO: `/v3/users/de408f76f5d749558458d545a280b3f2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.417716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473f815-bc96-4e1b-afea-31cee7747f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.418706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de408f76f5d749558458d545a280b3f2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.419072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f815-bc96-4e1b-afea-31cee7747f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.419757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f815-bc96-4e1b-afea-31cee7747f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.420243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473f815-bc96-4e1b-afea-31cee7747f7c admin admin] PATH_INFO: `/v3/projects/cc9cc23e6ba14ca59a3a1f1294fb59ac/users/43f26d74d69b4f1a87523b8a25e1e611/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.425737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473f815-bc96-4e1b-afea-31cee7747f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9cc23e6ba14ca59a3a1f1294fb59ac, user_id=43f26d74d69b4f1a87523b8a25e1e611, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:17.426880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.430580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473f815-bc96-4e1b-afea-31cee7747f7c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:17.455834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 787/1593] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:17 2022] PUT /identity/v3/projects/cc9cc23e6ba14ca59a3a1f1294fb59ac/users/43f26d74d69b4f1a87523b8a25e1e611/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:17.467853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc8874-691c-4c1a-a6a3-a95558cc1319 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.468323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc8874-691c-4c1a-a6a3-a95558cc1319 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.469416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc8874-691c-4c1a-a6a3-a95558cc1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.506649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ebcc8874-691c-4c1a-a6a3-a95558cc1319 None None] MFA Rules not processed for user `43f26d74d69b4f1a87523b8a25e1e611`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:17.508483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ebcc8874-691c-4c1a-a6a3-a95558cc1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.511253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de408f76f5d749558458d545a280b3f2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.525006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de408f76f5d749558458d545a280b3f2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.526285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de408f76f5d749558458d545a280b3f2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.527188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de408f76f5d749558458d545a280b3f2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.535509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de408f76f5d749558458d545a280b3f2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:17.559863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 807/1594] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:17 2022] DELETE /identity/v3/users/de408f76f5d749558458d545a280b3f2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:17.600672 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 788/1595] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:17.728017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:17.729489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.869006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b953ba-380d-41a0-8af5-bb9835b57854 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:17.880372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:17.881016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.881297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.881571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.887768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:17.915380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85678-2b05-4ade-85ed-39ae30f3b41f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.916332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85678-2b05-4ade-85ed-39ae30f3b41f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.916625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d85678-2b05-4ade-85ed-39ae30f3b41f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.919023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 789/1596] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:12:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 17 03:12:17.931351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:17.932101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:17.932276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:17.993399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:17.994748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:18.006767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:18.079726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:18.083299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:18.098755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 790/1597] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:12:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:18.099780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:18.101091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:18.101754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 808/1598] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:18.150925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:18.152556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:18.164057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:18.186376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6022-3a45-4105-9f18-0911dee1cbe0 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:18.200043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4a54e-fca0-42cc-a97b-0db52a026a05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:18.201272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4a54e-fca0-42cc-a97b-0db52a026a05 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.201553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4a54e-fca0-42cc-a97b-0db52a026a05 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.201822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4a54e-fca0-42cc-a97b-0db52a026a05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.216963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a5c96-f3e1-42a4-8581-1a81c298c39b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:18.230051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4a54e-fca0-42cc-a97b-0db52a026a05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:18.231675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4a54e-fca0-42cc-a97b-0db52a026a05 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:18.243141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:18.243816 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.244128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.245476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] PATH_INFO: `/v3/projects/1842f1c0bb5247c2854134ae79d622e3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.248549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1842f1c0bb5247c2854134ae79d622e3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:18.251434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:18.275007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 809/1599] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:18.363917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1842f1c0bb5247c2854134ae79d622e3', 'request_id': 'req-d13f3b99-b195-4963-b83f-d87ee480f341'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:18.378531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1842f1c0bb5247c2854134ae79d622e3', 'request_id': 'req-d13f3b99-b195-4963-b83f-d87ee480f341'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:18.391805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1842f1c0bb5247c2854134ae79d622e3', 'request_id': 'req-d13f3b99-b195-4963-b83f-d87ee480f341'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:18.416551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] The token cache is being invalidate because project 1842f1c0bb5247c2854134ae79d622e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:18.417235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:18.419107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d13f3b99-b195-4963-b83f-d87ee480f341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:18.421102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 791/1600] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:18 2022] DELETE /identity/v3/projects/1842f1c0bb5247c2854134ae79d622e3 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:18.427300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.427592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.427889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.454986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:18.456399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:18.642724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 810/1601] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:18.645842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.646169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.646412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.674069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:18.674853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:18.686440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 792/1602] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:18.690465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:18.702057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f53c1b-70f6-413c-90c9-4e086c44459c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:18.721170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:18.722131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.722455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.722737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.723397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:18.723702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:18.725346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:18.744868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 811/1603] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:18.749655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:18.763976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ae9b8-836e-4380-92be-93f20b452c8c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:18.773956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:18.774801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.776066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.776615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.777586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:18.780657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:18.830662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 793/1604] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:18 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:18.834671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:18.856403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae6355-a34b-4e36-a661-e418204da494 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:18.948172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:18.949114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:18.949622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:18.950097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:18.950956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:18.954184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:18.983300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 812/1605] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:18 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:18.988031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.014705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b9251-35d2-4367-9beb-2add18fe64e4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.022439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.023113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.023404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.023680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.024749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.027149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.042322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 794/1606] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:19.046273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.061710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d212a8-459e-4172-a145-f5b782906c8e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.073419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4c9c8-513a-44a5-af45-6c57155404d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.075396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4c9c8-513a-44a5-af45-6c57155404d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.076129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4c9c8-513a-44a5-af45-6c57155404d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.077189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4c9c8-513a-44a5-af45-6c57155404d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.078998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4c9c8-513a-44a5-af45-6c57155404d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.082029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4c9c8-513a-44a5-af45-6c57155404d8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.112405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 813/1607] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:19.112600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.130068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50478087-4351-438c-a5ca-e7ebc53ef939 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.137278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.147682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.149213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.149579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] PATH_INFO: `/v3/projects/384e785c71d94c34845cadb62960bbcb/users/20b6633678204e1ca3df7f2e63ee2195/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.183264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=384e785c71d94c34845cadb62960bbcb, user_id=20b6633678204e1ca3df7f2e63ee2195, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.188533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.215940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 795/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:19 2022] PUT /identity/v3/projects/384e785c71d94c34845cadb62960bbcb/users/20b6633678204e1ca3df7f2e63ee2195/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:19.219684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.220106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.220341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.261819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] MFA Rules not processed for user `20b6633678204e1ca3df7f2e63ee2195`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:19.264215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:19.305046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.306915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:19.307792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:19.372819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 814/1609] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:19.378371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.404163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda992b-60b9-4c94-b31e-88575d25e1ac admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.409513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.410199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.410828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.411104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] PATH_INFO: `/v3/users/a97b49b42fdf4fcc8d4cf94f52f33110` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.413303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97b49b42fdf4fcc8d4cf94f52f33110)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.416197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.427090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:19.450669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb40fe-5c05-452b-bb69-6adcaf80ed1c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.456836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.457455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.457793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.459548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.460244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.462140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.472159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97b49b42fdf4fcc8d4cf94f52f33110'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:19.482242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97b49b42fdf4fcc8d4cf94f52f33110'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:19.483040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97b49b42fdf4fcc8d4cf94f52f33110'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:19.483679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97b49b42fdf4fcc8d4cf94f52f33110'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:19.493934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f91e2fcf-1944-4b6d-9ab7-ccd184819ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97b49b42fdf4fcc8d4cf94f52f33110'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:19.496616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 815/1610] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:19 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:19.500912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.502572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:19.521287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 796/1611] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:19 2022] DELETE /identity/v3/users/a97b49b42fdf4fcc8d4cf94f52f33110 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:19.526825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.527124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.527401 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.548861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:19.550303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:19.596492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8466a7-512b-4f62-b26e-a4208f7af17b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.621743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 797/1612] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:19.629646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.631076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:19.658822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:19.670098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.670713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.670998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.671271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.672493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.674417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.698334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe07a-7b52-456a-b9e7-7719b354e382 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.702457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.703777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.704268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.704681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.706481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 816/1613] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:19 2022] POST /identity/v3/users => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:19.710324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.721961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.721961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.723358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701fc4e-1adb-42d6-bbdd-c96749e2ec84 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.728938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.729550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.729837 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.730111 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.730789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.732313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 798/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:19.732422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.748052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 817/1615] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:19.752484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.768151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76981164-26d5-456e-afc1-59b6a914e50c service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.774519 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.775763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.776370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.776934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] PATH_INFO: `/v3/projects/d2edf8ca205c45a3a376bf7a81a7c192/users/7ec7f656b8d6406b864102a9b514f849/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.800763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2edf8ca205c45a3a376bf7a81a7c192, user_id=7ec7f656b8d6406b864102a9b514f849, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.804564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.833795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 799/1616] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:19 2022] PUT /identity/v3/projects/d2edf8ca205c45a3a376bf7a81a7c192/users/7ec7f656b8d6406b864102a9b514f849/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:19.835889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:19.851354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf645fc-c0e4-45c6-80e7-15bc10abf479 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:19.970927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d20ee-dd9f-4d87-9cf4-2fda56be7324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:19.971639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d20ee-dd9f-4d87-9cf4-2fda56be7324 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:19.971964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d20ee-dd9f-4d87-9cf4-2fda56be7324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:19.972243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d20ee-dd9f-4d87-9cf4-2fda56be7324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:19.972888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d20ee-dd9f-4d87-9cf4-2fda56be7324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:19.975000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d20ee-dd9f-4d87-9cf4-2fda56be7324 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:19.987934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 818/1617] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:19.991807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:20.003601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c570-3a08-4650-af0a-cadc92e4462f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:20.008344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:20.009018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:20.009333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:20.009631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] PATH_INFO: `/v3/projects/d2edf8ca205c45a3a376bf7a81a7c192/users/7ec7f656b8d6406b864102a9b514f849/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:20.012660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2edf8ca205c45a3a376bf7a81a7c192, user_id=7ec7f656b8d6406b864102a9b514f849, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:20.015431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:20.018485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:20.029663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 800/1618] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:19 2022] PUT /identity/v3/projects/d2edf8ca205c45a3a376bf7a81a7c192/users/7ec7f656b8d6406b864102a9b514f849/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:20.039742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:20.040100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:20.040383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:20.065265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:20.067678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:20.072870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] MFA Rules not processed for user `7ec7f656b8d6406b864102a9b514f849`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:20.074222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:20.149413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02811e3-60b9-4a66-9d33-8ba7e9d265fe admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:20.154479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:20.155114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:20.155435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:20.155731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] PATH_INFO: `/v3/projects/8dc458d683934588942bd3edaeb3f7bc` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:20.157465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc458d683934588942bd3edaeb3f7bc)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:20.159367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:20.187760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 819/1619] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:20 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:20.199447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:20.200887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:20.213798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc458d683934588942bd3edaeb3f7bc', 'request_id': 'req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.225213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc458d683934588942bd3edaeb3f7bc', 'request_id': 'req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.236960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc458d683934588942bd3edaeb3f7bc', 'request_id': 'req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.250467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] The token cache is being invalidate because project 8dc458d683934588942bd3edaeb3f7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:20.250769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.251609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.254028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 801/1620] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:20 2022] DELETE /identity/v3/projects/8dc458d683934588942bd3edaeb3f7bc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:20.257835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:20.259294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:20.263618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdcfed-de4d-4acc-94c6-0bd6f4134fe6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:20.269054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:20.323625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:20.324532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:20.324885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:20.325228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:20.327084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:20.351592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d6e4f-eb0a-4d9d-ad33-bf8b97042ad3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:20.357446 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:20.358103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:20.358358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:20.358658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] PATH_INFO: `/v3/users/6de9c7b3de5e4c5bb1c364777fa0efdd` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:20.360801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de9c7b3de5e4c5bb1c364777fa0efdd)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:20.362722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:20.401268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:20.442054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:20.443534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de9c7b3de5e4c5bb1c364777fa0efdd'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.443651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:20.452271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de9c7b3de5e4c5bb1c364777fa0efdd'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.453305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de9c7b3de5e4c5bb1c364777fa0efdd'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.454084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de9c7b3de5e4c5bb1c364777fa0efdd'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.461072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 820/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:20 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:20.466568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de9c7b3de5e4c5bb1c364777fa0efdd'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:20.493338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 802/1622] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:20 2022] DELETE /identity/v3/users/6de9c7b3de5e4c5bb1c364777fa0efdd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:20.866584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:20.880040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e389c19-6660-4378-ae8c-69fae01426c8 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:20.889769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:20.891760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:20.980810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:20.981373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:20.981905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:20.982703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] PATH_INFO: `/v3/projects/8090632e3f224d9ea17986a002add8ea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:20.984468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8090632e3f224d9ea17986a002add8ea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:20.987396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.026584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffd3e0-37ae-499f-be3d-4d974c4910dc admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.032868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.033868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.034327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.034987 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] PATH_INFO: `/v3/users/20b6633678204e1ca3df7f2e63ee2195` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.036795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b6633678204e1ca3df7f2e63ee2195)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.039221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.124673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8090632e3f224d9ea17986a002add8ea', 'request_id': 'req-54b82e8c-762e-420c-b21d-2d75f39082df'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.135160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8090632e3f224d9ea17986a002add8ea', 'request_id': 'req-54b82e8c-762e-420c-b21d-2d75f39082df'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.159074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8090632e3f224d9ea17986a002add8ea', 'request_id': 'req-54b82e8c-762e-420c-b21d-2d75f39082df'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.163508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:21.203555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] The token cache is being invalidate because project 8090632e3f224d9ea17986a002add8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:21.204274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.205696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-54b82e8c-762e-420c-b21d-2d75f39082df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.211860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 821/1623] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:20 2022] DELETE /identity/v3/projects/8090632e3f224d9ea17986a002add8ea => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:21.216860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05983e-9df6-475c-bfad-7ef9e76afad2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.217352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05983e-9df6-475c-bfad-7ef9e76afad2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.217819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05983e-9df6-475c-bfad-7ef9e76afad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.219160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b6633678204e1ca3df7f2e63ee2195'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.253527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b6633678204e1ca3df7f2e63ee2195'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.254533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b6633678204e1ca3df7f2e63ee2195'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.255607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b6633678204e1ca3df7f2e63ee2195'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.258983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dc05983e-9df6-475c-bfad-7ef9e76afad2 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:21.260505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dc05983e-9df6-475c-bfad-7ef9e76afad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.268107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b6633678204e1ca3df7f2e63ee2195'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.309797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 803/1624] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:20 2022] DELETE /identity/v3/users/20b6633678204e1ca3df7f2e63ee2195 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:21.313408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.315635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.346916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:21.370571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 822/1625] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:21.371835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102418-2e90-489b-a934-b6d2094a70cb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.372159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102418-2e90-489b-a934-b6d2094a70cb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.372427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102418-2e90-489b-a934-b6d2094a70cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.391915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47241209-f2d5-4244-881b-5c5660f08592 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.393752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5d102418-2e90-489b-a934-b6d2094a70cb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:21.395123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5d102418-2e90-489b-a934-b6d2094a70cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.396733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.397424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.397728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.397989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] PATH_INFO: `/v3/users/70f1eab02a1f4212814222b0b04a4d7d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.399153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f1eab02a1f4212814222b0b04a4d7d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.401093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.404313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 823/1626] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:21.405300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.405585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.405855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.426551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:21.427739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.436077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 824/1627] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:21.437073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.438957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.458358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f1eab02a1f4212814222b0b04a4d7d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.465434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f1eab02a1f4212814222b0b04a4d7d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.466130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f1eab02a1f4212814222b0b04a4d7d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.466763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f1eab02a1f4212814222b0b04a4d7d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.474749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f1eab02a1f4212814222b0b04a4d7d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:21.493084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 804/1628] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:21 2022] DELETE /identity/v3/users/70f1eab02a1f4212814222b0b04a4d7d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:21.493905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.495204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.497780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf0aa9-59e0-4cd4-b2bd-98eb1c0410bb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.546133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.547314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.547682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.547883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.549623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.560321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1d95-bc8a-4a5f-9862-723fdad4c98f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.561364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.563104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7af9c5-9d89-49e0-bbe3-da6c7cb844a9 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.565076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.565688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.565973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.566247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.566895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:21.567200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.568853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.573806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 825/1629] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:21.575059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.575358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.576126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.584404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 805/1630] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:21.585385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.595027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:21.596270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.596594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6106f44-c081-46c4-81cb-e9c9120744c9 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.601619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.602227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.602511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.602781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.603417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.608001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 826/1631] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:21.608131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.617324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.619022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.637186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06bd17-1f8b-4be8-a2b4-f211f822f7fa None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.641747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.642377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.642662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.642937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.644096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 806/1632] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:21 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:21.648255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.656398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.658423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.669934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 827/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:21.672690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:21.732698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04091c-928f-4b4f-99c7-4792992c721b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.738663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.739502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.739854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.740245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.740978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.742996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.776283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 807/1634] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:21 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:21.777453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.794260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae88e-7a13-4b37-ba1c-640a5fdf8c39 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.800568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.801434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.801723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.802085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.802994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.811527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.825224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 828/1635] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:21.831603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.845303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b4179-1431-4494-9fdc-c2db45de6bb0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.856553 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.857321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.857704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.858415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.858832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.861293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.889118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.900516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 808/1636] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:21.902853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:21.906548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c7361-e5ce-4beb-8ab1-d7b838d741da admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:21.922923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9704383-b958-4e35-a946-4b017a2edae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:21.923648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9704383-b958-4e35-a946-4b017a2edae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:21.924858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9704383-b958-4e35-a946-4b017a2edae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:21.925173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9704383-b958-4e35-a946-4b017a2edae6 admin admin] PATH_INFO: `/v3/projects/5d60b9ced63f4cdd92451fbb4aa8cf7f/users/8075d09b5e1542388ca70bceab6bec0a/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:21.966276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:21.968882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:21.981997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9704383-b958-4e35-a946-4b017a2edae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d60b9ced63f4cdd92451fbb4aa8cf7f, user_id=8075d09b5e1542388ca70bceab6bec0a, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:21.985266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9704383-b958-4e35-a946-4b017a2edae6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:21.995280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9257f-5380-47df-92df-855e0a72f84b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.001385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.002564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.002785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.003296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] PATH_INFO: `/v3/projects/384e785c71d94c34845cadb62960bbcb` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.004588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=384e785c71d94c34845cadb62960bbcb)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.006631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.018324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 829/1637] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:21 2022] PUT /identity/v3/projects/5d60b9ced63f4cdd92451fbb4aa8cf7f/users/8075d09b5e1542388ca70bceab6bec0a/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:22.030423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.030985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.037436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.106872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] MFA Rules not processed for user `8075d09b5e1542388ca70bceab6bec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:22.108175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.110790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384e785c71d94c34845cadb62960bbcb', 'request_id': 'req-19281b03-0045-4a8a-99ca-718b993f3a4f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.149397 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384e785c71d94c34845cadb62960bbcb', 'request_id': 'req-19281b03-0045-4a8a-99ca-718b993f3a4f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.161269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384e785c71d94c34845cadb62960bbcb', 'request_id': 'req-19281b03-0045-4a8a-99ca-718b993f3a4f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.185432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] The token cache is being invalidate because project 384e785c71d94c34845cadb62960bbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:22.185875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.188915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.192382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 809/1638] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:21 2022] DELETE /identity/v3/projects/384e785c71d94c34845cadb62960bbcb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:22.196834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.199175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.248518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 830/1639] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:22.250374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.252961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.321692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19281b03-0045-4a8a-99ca-718b993f3a4f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.327310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.328093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.328384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.328785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] PATH_INFO: `/v3/users/7ec7f656b8d6406b864102a9b514f849` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.330581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ec7f656b8d6406b864102a9b514f849)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.333774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.361253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:22.444961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ec7f656b8d6406b864102a9b514f849'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.448827 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985001b0-a08d-4f80-ace6-e59f0aed0c71 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.461072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.461206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ec7f656b8d6406b864102a9b514f849'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.461708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.462248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ec7f656b8d6406b864102a9b514f849'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.462373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.462540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.462968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ec7f656b8d6406b864102a9b514f849'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.463330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.466672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.491625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ec7f656b8d6406b864102a9b514f849'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.517948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 831/1640] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:22 2022] POST /identity/v3/projects => generated 385 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:22.519015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.520894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.523189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 810/1641] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:22 2022] DELETE /identity/v3/users/7ec7f656b8d6406b864102a9b514f849 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:22.523787 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.526835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.629419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:22.644950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918c664-5c64-4f09-a631-1e74298acaf3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.646109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ffead-2b1c-40d7-89c4-7f3986c0ef42 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.657564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.658853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.659243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.659624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] PATH_INFO: `/v3/projects/5567d94cf3a34f27a677d0a5c674fb32` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.661601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5567d94cf3a34f27a677d0a5c674fb32)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.662918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.663574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.663901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.664000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.664225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.664938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.667219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.704158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 811/1642] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:22 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:22.705135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.724417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1579dca-93ba-48b9-9e3a-8967f8fbaf45 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.740701 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5567d94cf3a34f27a677d0a5c674fb32', 'request_id': 'req-4a879c21-5678-4ecd-ac55-cf1d905738a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.758298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5567d94cf3a34f27a677d0a5c674fb32', 'request_id': 'req-4a879c21-5678-4ecd-ac55-cf1d905738a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.770812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5567d94cf3a34f27a677d0a5c674fb32', 'request_id': 'req-4a879c21-5678-4ecd-ac55-cf1d905738a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.804579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] The token cache is being invalidate because project 5567d94cf3a34f27a677d0a5c674fb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:22.805030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.805955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.807733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 832/1643] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:22 2022] DELETE /identity/v3/projects/5567d94cf3a34f27a677d0a5c674fb32 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:22.814006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.815637 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.831534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.832450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.833005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.833467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.834661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.836844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.847561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 812/1644] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:22.851494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.853384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:22.872363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4e00-70b1-4cdd-9c5a-f7a5a68bad5e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.879754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.880959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.881144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.881572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.882224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.884469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.896553 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 813/1645] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:22.898504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a879c21-5678-4ecd-ac55-cf1d905738a2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.900350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:22.904944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.905838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.906742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.907120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] PATH_INFO: `/v3/users/89e0ae785da94b6f834dba6000abe5ac` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.909357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e0ae785da94b6f834dba6000abe5ac)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.911493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.911956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ebeaa-8c57-44dd-a9c1-2ecdcc4d88f6 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:22.918372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce504b-0f97-486b-86d8-1ff886c600af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:22.919697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce504b-0f97-486b-86d8-1ff886c600af admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.919697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce504b-0f97-486b-86d8-1ff886c600af admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.919697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce504b-0f97-486b-86d8-1ff886c600af admin admin] PATH_INFO: `/v3/projects/6f5765c03142419dbd46ab6b09637273/users/6691dc67299641cb85084d14f79722b0/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.929223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:22.947346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce504b-0f97-486b-86d8-1ff886c600af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f5765c03142419dbd46ab6b09637273, user_id=6691dc67299641cb85084d14f79722b0, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:22.950430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce504b-0f97-486b-86d8-1ff886c600af admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:22.970873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 814/1646] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:22 2022] PUT /identity/v3/projects/6f5765c03142419dbd46ab6b09637273/users/6691dc67299641cb85084d14f79722b0/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:22.974579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e0ae785da94b6f834dba6000abe5ac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.982283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:22.982564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:22.982835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:22.985486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e0ae785da94b6f834dba6000abe5ac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.986520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e0ae785da94b6f834dba6000abe5ac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.987221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e0ae785da94b6f834dba6000abe5ac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:22.998276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e0ae785da94b6f834dba6000abe5ac'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.017764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] MFA Rules not processed for user `6691dc67299641cb85084d14f79722b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:23.020007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.021114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 833/1647] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:22 2022] DELETE /identity/v3/users/89e0ae785da94b6f834dba6000abe5ac => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:23.106582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 815/1648] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:23.111001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.113521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.122650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:23.209468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885e71-e88a-480f-9160-6a1213fac6b6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.217023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.218166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.218812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.219204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.220453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.222910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.258836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 834/1649] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:23 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:23.263944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.279034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efa1ce-aa43-4078-afbe-cb1f77f70bab None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.343508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.345293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.365279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.366214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.366214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.367050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.367723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.370080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.435696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 816/1650] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:23 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:23.441231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.456080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6728a51-f597-4c9d-be6b-98d9413f8751 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.458844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a719f-f34d-4c69-b2e3-f609a4192f78 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.461382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.462084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.462432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.462773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.463494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.465218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.469907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.470793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.471245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.471667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] PATH_INFO: `/v3/projects/58c07a2f5c7c4e9dbbf326fe26bed540` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.475155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c07a2f5c7c4e9dbbf326fe26bed540)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.476734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 817/1651] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:23.477523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.478345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.482138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.500578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c800d5-746e-401b-bd5d-8764201f3206 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.511462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.512432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.513470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.516938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] PATH_INFO: `/v3/projects/d2edf8ca205c45a3a376bf7a81a7c192` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.519387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2edf8ca205c45a3a376bf7a81a7c192)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.523806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.623271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c07a2f5c7c4e9dbbf326fe26bed540', 'request_id': 'req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.626645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:23.628616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2edf8ca205c45a3a376bf7a81a7c192', 'request_id': 'req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.637863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c07a2f5c7c4e9dbbf326fe26bed540', 'request_id': 'req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.641175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2edf8ca205c45a3a376bf7a81a7c192', 'request_id': 'req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.648249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c07a2f5c7c4e9dbbf326fe26bed540', 'request_id': 'req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.652388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2edf8ca205c45a3a376bf7a81a7c192', 'request_id': 'req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.667034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] The token cache is being invalidate because project 58c07a2f5c7c4e9dbbf326fe26bed540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:23.670108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.670108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.670108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 835/1652] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:23 2022] DELETE /identity/v3/projects/58c07a2f5c7c4e9dbbf326fe26bed540 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:23.673794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.675627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.682549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] The token cache is being invalidate because project d2edf8ca205c45a3a376bf7a81a7c192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:23.684165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.685679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:23.691617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 818/1653] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:23 2022] DELETE /identity/v3/projects/d2edf8ca205c45a3a376bf7a81a7c192 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:23.692820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:23.698757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.716852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:23.817178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9ce10-fdd3-45b1-9d33-93b5aa13506a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.865410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3ee22-00c3-47d7-a14e-2cef92c8e7e7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:23.882973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.884294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.888705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.889232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] PATH_INFO: `/v3/users/2a9051d5c0e24de7aba2c7057fcae6e4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.891416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9051d5c0e24de7aba2c7057fcae6e4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.893192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01b273-231b-47e8-b1b3-25c2f0abc2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:23.893666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.894564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01b273-231b-47e8-b1b3-25c2f0abc2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.894994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01b273-231b-47e8-b1b3-25c2f0abc2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.895416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01b273-231b-47e8-b1b3-25c2f0abc2ff admin admin] PATH_INFO: `/v3/projects/bda335ab67524c649b59de4e1cc345b4/users/98649eccd9ee43f98b3885012b850664/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.916080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01b273-231b-47e8-b1b3-25c2f0abc2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda335ab67524c649b59de4e1cc345b4, user_id=98649eccd9ee43f98b3885012b850664, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:23.919771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01b273-231b-47e8-b1b3-25c2f0abc2ff admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:23.944494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 836/1654] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:23 2022] PUT /identity/v3/projects/bda335ab67524c649b59de4e1cc345b4/users/98649eccd9ee43f98b3885012b850664/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:23.946038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:23.946329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:23.946607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:23.982951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:23.984931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:23.991668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9051d5c0e24de7aba2c7057fcae6e4'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.001538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9051d5c0e24de7aba2c7057fcae6e4'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.002313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9051d5c0e24de7aba2c7057fcae6e4'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.003702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9051d5c0e24de7aba2c7057fcae6e4'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.016556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9051d5c0e24de7aba2c7057fcae6e4'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.051452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 819/1655] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:23 2022] DELETE /identity/v3/users/2a9051d5c0e24de7aba2c7057fcae6e4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:24.055079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.057642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.140063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 837/1656] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:24.140063 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.143268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.154019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:24.163322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8a587-7af2-4982-9703-b6646672f5c3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.175337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f95b11-8939-4627-ad2d-97dcbddfb96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.176744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95b11-8939-4627-ad2d-97dcbddfb96c admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.177228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95b11-8939-4627-ad2d-97dcbddfb96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.177820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95b11-8939-4627-ad2d-97dcbddfb96c admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.179303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f95b11-8939-4627-ad2d-97dcbddfb96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.182315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f95b11-8939-4627-ad2d-97dcbddfb96c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.201936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 820/1657] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:24.204271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.204901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.205187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.232654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:24.234952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.245539 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 821/1658] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:24.246718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.259220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb633-b137-45fd-91fd-69d9c995318e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.261270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5de8-63f4-48ea-9713-3546894102eb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.267085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.267768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.268998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:24.269778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.270115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] PATH_INFO: `/v3/projects/bda335ab67524c649b59de4e1cc345b4/users/98649eccd9ee43f98b3885012b850664/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.279167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda335ab67524c649b59de4e1cc345b4, user_id=98649eccd9ee43f98b3885012b850664, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.282156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.307512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 822/1659] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:24 2022] PUT /identity/v3/projects/bda335ab67524c649b59de4e1cc345b4/users/98649eccd9ee43f98b3885012b850664/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:24.308630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.378311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.378938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.379221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.379522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.381769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.431544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7970b-3a30-431a-b34d-0a69ca4b0a5a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.438308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.439093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.439482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.440350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.440900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:24.442065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.444919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1110e9-4bfe-42a1-b28c-fb0d868eb68e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.471538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 823/1660] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:24.474494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.474785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.475062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.514889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.516877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.532898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 838/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:24.534539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.541724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] MFA Rules not processed for user `98649eccd9ee43f98b3885012b850664`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:24.543341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.555066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131a8be-fa43-4d7e-b0c9-ec190c5f6a3d service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.564349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.565031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.565598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.565970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.567815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.572485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.632557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 839/1662] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:24 2022] POST /identity/v3/projects => generated 359 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:24.635203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.638773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.739208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 824/1663] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:24.740415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.748069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b545c9e-cab8-4847-aa2c-845b30d43af3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.754562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.755778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.756176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dbb1f0-c1ce-430a-9dc8-2065f5b966fe None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.756713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.757026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] PATH_INFO: `/v3/projects/7c1072c0a1d64640901be54698b68289` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.758260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1072c0a1d64640901be54698b68289)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.760689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.763513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.764488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.764789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.765069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.766348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:24.769232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:24.800723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 825/1664] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:24 2022] POST /identity/v3/users => generated 280 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:24.800723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.800964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.815838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:24.830835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1072c0a1d64640901be54698b68289', 'request_id': 'req-99d47770-4f63-4c52-9ecd-b526e80cee90'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.841141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1072c0a1d64640901be54698b68289', 'request_id': 'req-99d47770-4f63-4c52-9ecd-b526e80cee90'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.849574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:24.854642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1072c0a1d64640901be54698b68289', 'request_id': 'req-99d47770-4f63-4c52-9ecd-b526e80cee90'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.871267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] The token cache is being invalidate because project 7c1072c0a1d64640901be54698b68289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:24.871863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.872747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:24.874916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 840/1665] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:24 2022] DELETE /identity/v3/projects/7c1072c0a1d64640901be54698b68289 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:24.875968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:24.882106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.886853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdb9df-0e6b-4c75-be0d-2e8df83e83ed admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:24.948129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:24.948767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:24.949181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:24.949354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:24.951175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:24.995307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47770-4f63-4c52-9ecd-b526e80cee90 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.010372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c899-7bc4-4a97-8fff-bdf0bfd24522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.011103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c899-7bc4-4a97-8fff-bdf0bfd24522 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.011398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c899-7bc4-4a97-8fff-bdf0bfd24522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.011677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c899-7bc4-4a97-8fff-bdf0bfd24522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.016017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c899-7bc4-4a97-8fff-bdf0bfd24522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.017819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c899-7bc4-4a97-8fff-bdf0bfd24522 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.057596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 841/1666] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:25.061736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4736-d974-4501-a4e7-e7d606fb7721 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.061956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4736-d974-4501-a4e7-e7d606fb7721 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.062231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4736-d974-4501-a4e7-e7d606fb7721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.084146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.086111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.098628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 826/1667] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:25.099629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.111716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88a8fc-2428-42a4-8409-ce42742d173a service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.132718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.133418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.133730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.134002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.135273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.137545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.152144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 827/1668] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:25.157497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.159382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-76ee4736-d974-4501-a4e7-e7d606fb7721 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:25.161204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-76ee4736-d974-4501-a4e7-e7d606fb7721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:25.171143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 842/1669] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:25.172484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73332d-fa47-43e9-9aa1-df6cdc98afcb admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.179599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.180092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.180206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55b495-be67-41e0-a2c7-4fe451d728da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.180543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.180833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b495-be67-41e0-a2c7-4fe451d728da admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.181116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b495-be67-41e0-a2c7-4fe451d728da admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.181394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55b495-be67-41e0-a2c7-4fe451d728da admin admin] PATH_INFO: `/v3/projects/bbb7df6537294063b60ccb106166bd82/users/67e3ff2b4b5146c898423147870523b1/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.201271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55b495-be67-41e0-a2c7-4fe451d728da admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb7df6537294063b60ccb106166bd82, user_id=67e3ff2b4b5146c898423147870523b1, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.204680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55b495-be67-41e0-a2c7-4fe451d728da admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.220706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 828/1670] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:25 2022] PUT /identity/v3/projects/bbb7df6537294063b60ccb106166bd82/users/67e3ff2b4b5146c898423147870523b1/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:25.237981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.241172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.241380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:25.241982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.242868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:25.314254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] MFA Rules not processed for user `67e3ff2b4b5146c898423147870523b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:25.315545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:25.348484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 843/1671] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:25.354403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.376895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd83cfe-ff02-4e5f-813e-6089f5ed9cce None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.389699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.391291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.391772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.392300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.394346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:25.394856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.397347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.417128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 844/1672] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:25.419279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:25.425343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.448749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 829/1673] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:25.450740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a4c9-c263-4e40-abd3-3e15a7b32abb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.464183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.465233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.466179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.466538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.469178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.476030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.535040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 845/1674] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:25 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:25.536319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.549216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.551362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc0a36-b8dd-497f-9500-b235d3b021bc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.552140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:25.592858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:25.660421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.661108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.661396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.661676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.662328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.665336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.678705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f77e5-224d-4911-a117-719961e0903b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.685606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.686241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.686521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.686796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.716847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 830/1675] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:25 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:25.720607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.733500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ee5ef-ed14-4ac0-847f-04b00a7c2599 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.741803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.742664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.743015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.743804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.744583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.746377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.760097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 831/1676] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:25.764565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.779636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196abd68-3718-4fe8-bcb5-09c068a7c2a2 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.794263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.794263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.794263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.794263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.794628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.794628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.808492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.810385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 832/1677] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:25.810622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.815011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.823598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 846/1678] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:25.828002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcc779-f062-4797-bd27-f7fb96c6384e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.835372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e5b17-a2c7-43f9-8963-3a4b17a2e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.835372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5b17-a2c7-43f9-8963-3a4b17a2e51d admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.835372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5b17-a2c7-43f9-8963-3a4b17a2e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.835808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e5b17-a2c7-43f9-8963-3a4b17a2e51d admin admin] PATH_INFO: `/v3/projects/33f1222610e443adabe64dca306ef9ab/users/6cfcef992daf46cc97a9127503e1093d/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.854456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:25.877852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5b17-a2c7-43f9-8963-3a4b17a2e51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f1222610e443adabe64dca306ef9ab, user_id=6cfcef992daf46cc97a9127503e1093d, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.881671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807e283-336a-4af7-9321-83594b9e7d6a service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:25.885378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e5b17-a2c7-43f9-8963-3a4b17a2e51d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.895097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:25.895850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.896146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.896441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] PATH_INFO: `/v3/users/67e3ff2b4b5146c898423147870523b1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:25.898253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e3ff2b4b5146c898423147870523b1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:25.900449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:25.929345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 833/1679] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:25 2022] PUT /identity/v3/projects/33f1222610e443adabe64dca306ef9ab/users/6cfcef992daf46cc97a9127503e1093d/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:25.943306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:25.944719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:25.945362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.028825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e3ff2b4b5146c898423147870523b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:26.036428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] MFA Rules not processed for user `6cfcef992daf46cc97a9127503e1093d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:26.041931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:26.053414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e3ff2b4b5146c898423147870523b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:26.053414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e3ff2b4b5146c898423147870523b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:26.054214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e3ff2b4b5146c898423147870523b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:26.069568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b56ad380-ec34-4995-be83-db6ae7fa2aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e3ff2b4b5146c898423147870523b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:26.103639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 847/1680] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:25 2022] DELETE /identity/v3/users/67e3ff2b4b5146c898423147870523b1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:26.105916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.106206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.106482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.145681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:26.147629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:26.248563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:26.272374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 848/1681] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:26.285854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 834/1682] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:26.286134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.286848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:26.287466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.291202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:26.361297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:26.402651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fa974-0467-4e87-857a-1e895feb98a2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.407316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:26.408032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.408317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.408590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.419836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:26.421644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:26.431736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791eed5-d906-44a6-b35d-1d59b644304f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.432376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 849/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:26.433066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.434390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:26.442745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:26.443744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.444462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.445008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.446595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:26.449553 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:26.497110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 835/1684] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:26 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:26.503599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.520038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dce71-eb7b-4540-ae82-0cb8f2342ca0 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.595511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:26.596194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.596476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.596749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.598768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:26.610423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf187952-d0a7-40ea-98d5-bd10938c6ed9 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.620847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:26.621620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.622091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.622368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.623223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:26.626435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:26.664244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 836/1685] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:26 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:26.666239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.681194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d91ad6-7dda-4c54-8303-0d471ebce21c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.697851 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:26.698640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.699656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.700628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.701879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:26.704974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:26.721862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 837/1686] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:26.726089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.729825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:26.731328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:26.736864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:26.741889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68c274-294c-4579-af1e-c6764032ecf9 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.746613 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 850/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:26.748142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:26.749198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:26.750296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:26.750727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] PATH_INFO: `/v3/projects/0965cc3c384844e8841333f1eabea77f/users/0120585b5c4e44d0be34a06e7d702c9e/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:26.772936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0965cc3c384844e8841333f1eabea77f, user_id=0120585b5c4e44d0be34a06e7d702c9e, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:26.776290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:26.809055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 838/1688] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:26 2022] PUT /identity/v3/projects/0965cc3c384844e8841333f1eabea77f/users/0120585b5c4e44d0be34a06e7d702c9e/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:26.813959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.831050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31106e0e-4ad3-41c8-9003-299b2d22de9c service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:26.918386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:26.920857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.003478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.004295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.004478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.004756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.005498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.008705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.031179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 851/1689] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:27.037307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.057038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dec8c-3699-4044-aa82-6aa2e9913319 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.070002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df326580-d83a-4878-88a4-bca4dbedcf67 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.074878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3463864-2500-4123-8a07-8629f61772f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.075954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.076606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463864-2500-4123-8a07-8629f61772f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.076696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.076915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.077214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] PATH_INFO: `/v3/projects/bbb7df6537294063b60ccb106166bd82` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.079406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb7df6537294063b60ccb106166bd82)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.080032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463864-2500-4123-8a07-8629f61772f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.081554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.083521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3463864-2500-4123-8a07-8629f61772f4 admin admin] PATH_INFO: `/v3/projects/0965cc3c384844e8841333f1eabea77f/users/0120585b5c4e44d0be34a06e7d702c9e/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.086348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3463864-2500-4123-8a07-8629f61772f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0965cc3c384844e8841333f1eabea77f, user_id=0120585b5c4e44d0be34a06e7d702c9e, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.093045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:27.093288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3463864-2500-4123-8a07-8629f61772f4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.120787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 852/1690] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:27 2022] PUT /identity/v3/projects/0965cc3c384844e8841333f1eabea77f/users/0120585b5c4e44d0be34a06e7d702c9e/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:27.132227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aac4f-357d-4424-b7af-c88e292d3e96 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.132227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aac4f-357d-4424-b7af-c88e292d3e96 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.132227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7aac4f-357d-4424-b7af-c88e292d3e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.180443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb7df6537294063b60ccb106166bd82', 'request_id': 'req-af6dfde2-023f-40d9-b2fb-2cc345065666'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.189925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb7df6537294063b60ccb106166bd82', 'request_id': 'req-af6dfde2-023f-40d9-b2fb-2cc345065666'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.191840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ed7aac4f-357d-4424-b7af-c88e292d3e96 None None] MFA Rules not processed for user `0120585b5c4e44d0be34a06e7d702c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:27.193594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ed7aac4f-357d-4424-b7af-c88e292d3e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.200843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb7df6537294063b60ccb106166bd82', 'request_id': 'req-af6dfde2-023f-40d9-b2fb-2cc345065666'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.247608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] The token cache is being invalidate because project bbb7df6537294063b60ccb106166bd82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:27.248782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.250660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-af6dfde2-023f-40d9-b2fb-2cc345065666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.257363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 839/1691] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:26 2022] DELETE /identity/v3/projects/bbb7df6537294063b60ccb106166bd82 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:27.263647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.264479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.264943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.308645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:27.311557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.386366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 853/1692] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:27.431167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 840/1693] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:27.439923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.440074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.440348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.463078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.464752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.465044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:27.466334 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.477598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 854/1694] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:27.481609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.492017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e74b7-7b2e-4dac-b595-6dc8a69b2620 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.496914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.497956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.498323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.498760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.499929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:27.500308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.502065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.514487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 855/1695] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:12:27.520178 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.538729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc527e2-317e-47a2-8bf2-847bf5f41578 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.543679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702c4e0-8e9e-4647-bf71-2e95ef3d3952 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.544121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.544719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.545051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.545279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.545913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.548062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.549759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.550640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.551050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.551405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.566444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.568461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.581238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 856/1696] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:27.582090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 841/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:27.582607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.585258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.589414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.607320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19615b31-f02e-487b-9d50-fb35d7941bff service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.629252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:27.668551 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79623f-821d-4ee7-8e5f-50b0d23d101d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.668715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:27.674458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.675188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.675515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.675888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] PATH_INFO: `/v3/users/b68c4a83207b4f3185c66ff8203a77d8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.677671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68c4a83207b4f3185c66ff8203a77d8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.679661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.704170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.704950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.705242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.705526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.706391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.711853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.739201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 842/1698] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:27.743017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.745231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68c4a83207b4f3185c66ff8203a77d8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.753764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39971775-80a3-4bcb-a288-05b2bf47e322 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.756658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68c4a83207b4f3185c66ff8203a77d8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.757786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68c4a83207b4f3185c66ff8203a77d8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.758784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68c4a83207b4f3185c66ff8203a77d8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.760981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.761715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.762073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.762347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.763025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.765697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.772383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7f9dec94-81d1-4775-81b3-7e61c1ce8e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68c4a83207b4f3185c66ff8203a77d8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:27.777805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 843/1699] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:27.781455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.785681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.801540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 857/1700] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:27 2022] DELETE /identity/v3/users/b68c4a83207b4f3185c66ff8203a77d8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:27.803444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44b62a-2329-4de9-9131-ce4f4dc77912 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.806164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.806578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.806935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.833411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:27.834782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.883953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.884638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.884932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.885258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.885931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.887774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.903911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 844/1701] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:27.908075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.918698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347b100-db8b-4b60-8de3-451e03e025a1 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:27.921405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 858/1702] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:27.924219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c9fa-7c6f-4e70-90bf-e9c805345d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:27.924878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c9fa-7c6f-4e70-90bf-e9c805345d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.925560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c9fa-7c6f-4e70-90bf-e9c805345d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.925560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c9fa-7c6f-4e70-90bf-e9c805345d82 admin admin] PATH_INFO: `/v3/projects/e14f323ceae048d48581e9164ca0c36a/users/08984eb64e1c442a930c6afea2564aac/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:27.931650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:27.933135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:27.941580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508c9fa-7c6f-4e70-90bf-e9c805345d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14f323ceae048d48581e9164ca0c36a, user_id=08984eb64e1c442a930c6afea2564aac, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:27.944373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508c9fa-7c6f-4e70-90bf-e9c805345d82 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:27.970298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 845/1703] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:27 2022] PUT /identity/v3/projects/e14f323ceae048d48581e9164ca0c36a/users/08984eb64e1c442a930c6afea2564aac/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:27.979254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:27.979609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:27.979982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.005126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:28.011019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163dcd0-4abd-4b86-b626-0cf0aebd70c0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.014852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] MFA Rules not processed for user `08984eb64e1c442a930c6afea2564aac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:28.016949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.074703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.075849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.075849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.075849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.091162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 846/1704] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:28.092120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.093865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.114916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:28.139750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.141671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.151083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 859/1705] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:28.155256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.160291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c18166-0d9f-4ae6-9092-7eb0e5d57962 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.165021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.165655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.165934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.166206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] PATH_INFO: `/v3/users/6cfcef992daf46cc97a9127503e1093d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.166429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8424fd-809f-409b-a576-2d4790abad74 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.167520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfcef992daf46cc97a9127503e1093d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.170769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.171705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.172348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.172814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.173268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.174249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.176172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.209355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 860/1706] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:28 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:28.213517 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.232763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfcef992daf46cc97a9127503e1093d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.243140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfcef992daf46cc97a9127503e1093d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.244125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfcef992daf46cc97a9127503e1093d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.244822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfcef992daf46cc97a9127503e1093d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.258496 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0b8a0b21-bc25-463f-af15-e17294195bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfcef992daf46cc97a9127503e1093d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.284562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 847/1707] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:28 2022] DELETE /identity/v3/users/6cfcef992daf46cc97a9127503e1093d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:28.289572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.289967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.290346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.313813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:28.315141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.330363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c85182-1ffb-49f6-b2a1-b81596f13994 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.390927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:28.426900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 848/1708] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:28.438015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.440318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.441826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.442732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.443120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.443502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.444291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.446546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.480763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 861/1709] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:28 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:28.482093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.484758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.502582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c969d-7705-4680-821a-60e1f255dc29 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.508990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.509922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.510942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.511653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.512400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.514454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.516991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:28.544828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 862/1710] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:28.553910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.554004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709541b-d295-4b46-ab4e-6cb96cf6d014 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.563491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.564272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.564574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.564836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.575071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea66023-8522-4a59-8db9-8336b3f1e59d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.584198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.586253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.586893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.587104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.587210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.587437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.588101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.591419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.612356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 849/1711] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:28.613679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.615418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.621306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 863/1712] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:28.622311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.642673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d962c91-4e3c-4f5c-af04-0b4fb36fa6ec service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.647669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14324d2d-cd48-4915-8320-6f9a5ddae545 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:28.658725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.660601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.663393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b02345-36e5-4d80-85bd-668eeaccb8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:28.663935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.664223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] PATH_INFO: `/v3/projects/e75d9fd385424e1cad7d865a6e1a7207` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.665674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b02345-36e5-4d80-85bd-668eeaccb8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.665674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b02345-36e5-4d80-85bd-668eeaccb8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.665994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b02345-36e5-4d80-85bd-668eeaccb8b7 admin admin] PATH_INFO: `/v3/projects/811bd1d7b0994696a38853d6d241466d/users/c7e64e8cc09247a7926dd0a9e458cb07/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.667493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75d9fd385424e1cad7d865a6e1a7207)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.673296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.706255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b02345-36e5-4d80-85bd-668eeaccb8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811bd1d7b0994696a38853d6d241466d, user_id=c7e64e8cc09247a7926dd0a9e458cb07, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:28.713542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b02345-36e5-4d80-85bd-668eeaccb8b7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:28.747017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 864/1713] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:28 2022] PUT /identity/v3/projects/811bd1d7b0994696a38853d6d241466d/users/c7e64e8cc09247a7926dd0a9e458cb07/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:28.759488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:28.759782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:28.760134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:28.793224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75d9fd385424e1cad7d865a6e1a7207', 'request_id': 'req-f360f368-2002-4f35-a2cd-131b3d5f1a43'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.806683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] MFA Rules not processed for user `c7e64e8cc09247a7926dd0a9e458cb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:28.808340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.810026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75d9fd385424e1cad7d865a6e1a7207', 'request_id': 'req-f360f368-2002-4f35-a2cd-131b3d5f1a43'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.821939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75d9fd385424e1cad7d865a6e1a7207', 'request_id': 'req-f360f368-2002-4f35-a2cd-131b3d5f1a43'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.844321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] The token cache is being invalidate because project e75d9fd385424e1cad7d865a6e1a7207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:28.844912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.846489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:28.849707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 850/1714] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:28 2022] DELETE /identity/v3/projects/e75d9fd385424e1cad7d865a6e1a7207 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:28.857820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.860594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:28.941538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 865/1715] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:28.965624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:28.967261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.061731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f368-2002-4f35-a2cd-131b3d5f1a43 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.069817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.070573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.071121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.071458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] PATH_INFO: `/v3/users/6f5b07fa625c45cf8baa2ce844014a75` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.073100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5b07fa625c45cf8baa2ce844014a75)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.075638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.103592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7108-fafa-466f-bb41-e5da688471fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.111339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.112207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.112519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.112804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.113799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.116318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.135402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:29.149083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5b07fa625c45cf8baa2ce844014a75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.154863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 866/1716] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:28 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:29.156643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.163888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5b07fa625c45cf8baa2ce844014a75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.164796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5b07fa625c45cf8baa2ce844014a75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.166131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5b07fa625c45cf8baa2ce844014a75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.178382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5b07fa625c45cf8baa2ce844014a75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.185802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:29.212547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 851/1717] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:28 2022] DELETE /identity/v3/users/6f5b07fa625c45cf8baa2ce844014a75 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:29.235217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98814bc1-5e98-495d-8a8d-e37251638df6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.268561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.270517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.310717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.311405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.311696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.312098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.312742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.327244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.368409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 867/1718] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:29 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:29.370959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.374221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.388079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba446e4c-1a66-439a-b135-f061853eb9f7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.391847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d4a5e-7080-437e-920c-bdef3ae379a9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.396710 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.397531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.397890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.398240 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] PATH_INFO: `/v3/projects/33f1222610e443adabe64dca306ef9ab` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.399669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f1222610e443adabe64dca306ef9ab)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.400243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.400857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.401265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.401544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.402091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.402197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.403793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.417868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 868/1719] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:29.425437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.437013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a95aa1-66aa-49aa-a32f-6b6b5e686351 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.443471 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.444622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.444908 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.445185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] PATH_INFO: `/v3/projects/709a0b7109a74828b79f8078741c4d25/users/a579c039d5174683a792658c956e0100/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.466142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709a0b7109a74828b79f8078741c4d25, user_id=a579c039d5174683a792658c956e0100, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.469748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.484827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f1222610e443adabe64dca306ef9ab', 'request_id': 'req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.492832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 869/1720] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:29 2022] PUT /identity/v3/projects/709a0b7109a74828b79f8078741c4d25/users/a579c039d5174683a792658c956e0100/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:29.495028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f1222610e443adabe64dca306ef9ab', 'request_id': 'req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.496935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.505143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f1222610e443adabe64dca306ef9ab', 'request_id': 'req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.526272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] The token cache is being invalidate because project 33f1222610e443adabe64dca306ef9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:29.526653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.527394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.533350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 852/1721] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:29 2022] DELETE /identity/v3/projects/33f1222610e443adabe64dca306ef9ab => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:29.534271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.536281 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.605371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:29.613838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a8b32-c0b4-4bf3-abf5-debc7f57fe03 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.619262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.620089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.620375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.620682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.621299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.623752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.636499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 870/1722] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:29.636819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab76e0-3665-42cb-9cc1-e27a9e5df42d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.637409 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.641603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.644329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.645192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.645471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.645803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] PATH_INFO: `/v3/users/0120585b5c4e44d0be34a06e7d702c9e` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.646898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0120585b5c4e44d0be34a06e7d702c9e)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.648886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.659028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8e7d3-bacc-4b16-89f8-688aec047452 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.668073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.668796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.669079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.669382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] PATH_INFO: `/v3/projects/1ec1363aab4745839605f0d3c599429d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.670717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec1363aab4745839605f0d3c599429d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.674628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:29.674754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.716508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0120585b5c4e44d0be34a06e7d702c9e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.726044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0120585b5c4e44d0be34a06e7d702c9e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.726872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0120585b5c4e44d0be34a06e7d702c9e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.727731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0120585b5c4e44d0be34a06e7d702c9e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.737172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0120585b5c4e44d0be34a06e7d702c9e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.744775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec1363aab4745839605f0d3c599429d', 'request_id': 'req-08ef4c8b-b84b-4a81-8083-be40af79b1ca'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.753531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec1363aab4745839605f0d3c599429d', 'request_id': 'req-08ef4c8b-b84b-4a81-8083-be40af79b1ca'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.762008 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec1363aab4745839605f0d3c599429d', 'request_id': 'req-08ef4c8b-b84b-4a81-8083-be40af79b1ca'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.766248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 853/1723] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:29 2022] DELETE /identity/v3/users/0120585b5c4e44d0be34a06e7d702c9e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:29.766797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:29.768339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.776915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] The token cache is being invalidate because project 1ec1363aab4745839605f0d3c599429d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:29.777215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.778065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08ef4c8b-b84b-4a81-8083-be40af79b1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:29.782884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 871/1724] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:29 2022] DELETE /identity/v3/projects/1ec1363aab4745839605f0d3c599429d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:29.784418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740c14-372f-4c6d-810e-4272e3e2412a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.784833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740c14-372f-4c6d-810e-4272e3e2412a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.785109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10740c14-372f-4c6d-810e-4272e3e2412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.814987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-10740c14-372f-4c6d-810e-4272e3e2412a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:29.816961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-10740c14-372f-4c6d-810e-4272e3e2412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.841967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7334f15-ab8c-4ff0-9092-d23ab69eb3d5 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:29.848432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26958449-c547-4bb2-9cff-5918fe616870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:29.849211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26958449-c547-4bb2-9cff-5918fe616870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.849681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26958449-c547-4bb2-9cff-5918fe616870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.849970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26958449-c547-4bb2-9cff-5918fe616870 admin admin] PATH_INFO: `/v3/projects/709a0b7109a74828b79f8078741c4d25/users/a579c039d5174683a792658c956e0100/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.852181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26958449-c547-4bb2-9cff-5918fe616870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709a0b7109a74828b79f8078741c4d25, user_id=a579c039d5174683a792658c956e0100, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:29.854895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26958449-c547-4bb2-9cff-5918fe616870 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:29.873991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 854/1725] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:29 2022] PUT /identity/v3/projects/709a0b7109a74828b79f8078741c4d25/users/a579c039d5174683a792658c956e0100/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:29.889202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.889861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.890569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.895623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 872/1726] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:29.906680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:29.907259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:29.907704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:29.928293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] MFA Rules not processed for user `a579c039d5174683a792658c956e0100`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:29.929527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:29.931351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:29.932644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.015593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 873/1727] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:30.019728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.023618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 855/1728] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:30.030372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd991b-55f1-411c-80e9-9c566c00b7b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.036425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.037044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.037324 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.037600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.038277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:30.038580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.040729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.047634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.050039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.059397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 874/1729] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:30.060850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.069842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:30.070720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:30.077983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa2724-fa12-462a-b22b-e809436855af admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.087486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.088917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.089208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.089822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.090706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.093702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.142019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf680fb-2b5a-44ef-b436-4a8b0b66aa34 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.152025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.153413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.154213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.154678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.157508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.159109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 875/1730] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:30.160080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.164641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.238274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.240641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.252991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 856/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:30.254146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.267288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58195b83-c8f2-4564-81c4-603308cfa24d service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.271041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ea056-e002-47e0-a8c9-e3820434c32e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.276522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.277743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.278483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.278864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.278991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] PATH_INFO: `/v3/projects/0965cc3c384844e8841333f1eabea77f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.279845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.280353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0965cc3c384844e8841333f1eabea77f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.280660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.281098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.282881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.283915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.287416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.332036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 857/1732] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/users => generated 289 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:30.336758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.350324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc491-7125-4404-ac17-ddedf7e7eeac admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.356901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0965cc3c384844e8841333f1eabea77f', 'request_id': 'req-aced734f-9c78-47b3-a217-4c85c55e7f6d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:30.367017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0965cc3c384844e8841333f1eabea77f', 'request_id': 'req-aced734f-9c78-47b3-a217-4c85c55e7f6d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:30.378713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0965cc3c384844e8841333f1eabea77f', 'request_id': 'req-aced734f-9c78-47b3-a217-4c85c55e7f6d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:30.394345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] The token cache is being invalidate because project 0965cc3c384844e8841333f1eabea77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:30.394685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:30.395350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aced734f-9c78-47b3-a217-4c85c55e7f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:30.397544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 876/1733] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:30 2022] DELETE /identity/v3/projects/0965cc3c384844e8841333f1eabea77f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:30.403191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9a97-f9ef-4560-9874-3ff7135a2650 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.403475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9a97-f9ef-4560-9874-3ff7135a2650 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.403752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9a97-f9ef-4560-9874-3ff7135a2650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.425973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-518d9a97-f9ef-4560-9874-3ff7135a2650 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:30.427393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-518d9a97-f9ef-4560-9874-3ff7135a2650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.431279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.432000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.432286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.432556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.433267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.435139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.440643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 877/1734] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:30.447799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.449170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.449455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.457325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 858/1735] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:30.461614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.466729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.479407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:30.480788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.481785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958c78e-7075-4d64-8234-514d77bd5d4e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.488690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.489451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.489856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.490221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.491132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.492261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 878/1736] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:30.493278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.496781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.508989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294b1a-bffa-4da6-b84d-d53b1d5d8d4a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.514442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.515774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.516193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.516537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.517301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:30.517671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.517824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 859/1737] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:30.518680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.519631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.529882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f74de-1fce-4561-8b5e-b470bef71267 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.549435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.550469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 879/1738] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:30.550644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.550914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.551737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] PATH_INFO: `/v3/projects/69240d0aafd34eb5bf360ee51afdef90/users/77d0af96f3b7410ba009df93954bd131/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.556194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.568995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d20ca-57a9-4811-a36b-3b14cf5ed601 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.575249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74495439-b17e-4c77-8882-30ab05b215db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.576144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495439-b17e-4c77-8882-30ab05b215db admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.576610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495439-b17e-4c77-8882-30ab05b215db admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.577116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74495439-b17e-4c77-8882-30ab05b215db admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.578119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74495439-b17e-4c77-8882-30ab05b215db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.581130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74495439-b17e-4c77-8882-30ab05b215db admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.592935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69240d0aafd34eb5bf360ee51afdef90, user_id=77d0af96f3b7410ba009df93954bd131, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.600759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.630760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 860/1739] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:30 2022] PUT /identity/v3/projects/69240d0aafd34eb5bf360ee51afdef90/users/77d0af96f3b7410ba009df93954bd131/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:30.637543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 880/1740] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:30.639231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.641141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.641429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.641793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.678594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:30.682372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] MFA Rules not processed for user `77d0af96f3b7410ba009df93954bd131`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:30.684103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:30.716606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:30.763004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca527-fa46-490e-88be-9289bb188239 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.805388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 881/1741] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:30.810183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.866598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.867467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.868257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.868614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.869319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.871977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.887469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b07c0-a08b-4c5f-8fce-a3db78add4c7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.893155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.893926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.894082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.894413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.894985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.897011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.902839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 861/1742] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:30.905058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.930068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdcc20-2c31-463e-acb7-1ecaf2d06698 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:30.934331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 882/1743] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:30.935722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:30.936516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:30.936947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:30.939198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:30.939198 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:30.940325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:30.941179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.963613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 862/1744] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:30.967206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:30.978644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4faf9a3-6b7e-48ed-9581-7bbd700c0150 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.051949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.052878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.053367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.053879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.054809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.055987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a788a-ee21-4603-a95b-6eab330cb5a9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.057308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.061304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.062708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.063088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.063464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.064243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.066342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.070326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 863/1745] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:31.075335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.090072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045b7e-cd85-4d5c-bebe-26cf257ddd6f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.092686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 883/1746] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:30 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:31.096763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.096956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0124e-8881-4251-a4b5-bef486202f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.097773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0124e-8881-4251-a4b5-bef486202f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.098070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0124e-8881-4251-a4b5-bef486202f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.098350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0124e-8881-4251-a4b5-bef486202f02 admin admin] PATH_INFO: `/v3/projects/b3ef256739cb476d94e7668cf96f7afa/users/6cc906c6fbf843448fa0f49daa46af0f/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.109259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b6c6e-0b23-4a9d-b479-2e27c3683a73 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.115898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.116852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.117136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.117407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.118079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.119663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.128123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0124e-8881-4251-a4b5-bef486202f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ef256739cb476d94e7668cf96f7afa, user_id=6cc906c6fbf843448fa0f49daa46af0f, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.131953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0124e-8881-4251-a4b5-bef486202f02 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.132881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 884/1747] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:31.137055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.148995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ca077-d3c8-478c-89d1-da64400f24ed admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.150872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 864/1748] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:31 2022] PUT /identity/v3/projects/b3ef256739cb476d94e7668cf96f7afa/users/6cc906c6fbf843448fa0f49daa46af0f/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:31.162722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.163018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.163322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.165780 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:31.182643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:31.194377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] MFA Rules not processed for user `6cc906c6fbf843448fa0f49daa46af0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:31.195952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.215532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.216243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.216573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.216889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] PATH_INFO: `/v3/projects/3291936876a44899aa758295dedbabb7/users/00e0832d3ef84dc89758f9cd81a11c82/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.236932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3291936876a44899aa758295dedbabb7, user_id=00e0832d3ef84dc89758f9cd81a11c82, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.241583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.258000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 885/1749] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:31 2022] PUT /identity/v3/projects/3291936876a44899aa758295dedbabb7/users/00e0832d3ef84dc89758f9cd81a11c82/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:31.261791 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.263455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.279586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 865/1750] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:31.281647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.298986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfea15-393e-476f-8217-bfc867415eeb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.336146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6005a-95e1-4299-8a11-b3acb3d09a93 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.341435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.342190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.344055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.344055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] PATH_INFO: `/v3/users/a348ca891f234ad099b12c252472a582` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.345238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a348ca891f234ad099b12c252472a582)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.347059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.376017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.376692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.376978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.377252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.377953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.379902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.399778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 866/1751] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:31.399778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.399778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.415397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a348ca891f234ad099b12c252472a582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:31.424278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a348ca891f234ad099b12c252472a582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:31.425199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a348ca891f234ad099b12c252472a582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:31.425975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a348ca891f234ad099b12c252472a582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:31.435814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a348ca891f234ad099b12c252472a582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:31.464634 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 886/1752] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:31 2022] DELETE /identity/v3/users/a348ca891f234ad099b12c252472a582 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:31.470105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.472177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.502053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:31.507096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf6a33-e760-4ce0-bcb2-61181a8f17e1 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.547607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:31.570116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77dd9d-0ceb-4261-933f-aeb554d6f901 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.570338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.570737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.571027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.571287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.573175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.575536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17595e-8a8a-4e3f-9ebe-9224d8db8561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.576512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17595e-8a8a-4e3f-9ebe-9224d8db8561 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.576902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17595e-8a8a-4e3f-9ebe-9224d8db8561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.577280 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17595e-8a8a-4e3f-9ebe-9224d8db8561 admin admin] PATH_INFO: `/v3/projects/3291936876a44899aa758295dedbabb7/users/00e0832d3ef84dc89758f9cd81a11c82/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.580317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17595e-8a8a-4e3f-9ebe-9224d8db8561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3291936876a44899aa758295dedbabb7, user_id=00e0832d3ef84dc89758f9cd81a11c82, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.582651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17595e-8a8a-4e3f-9ebe-9224d8db8561 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.594155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 887/1753] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:31 2022] PUT /identity/v3/projects/3291936876a44899aa758295dedbabb7/users/00e0832d3ef84dc89758f9cd81a11c82/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:31.605369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.605646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.605919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.639392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:31.643549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.655472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.657223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfecfd0-92b7-4413-a9f1-ff875177d3c9 service glance] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.670933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 867/1754] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:31.689561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.689561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.689561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.725075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 888/1755] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:31.735344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.737764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.741782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] MFA Rules not processed for user `00e0832d3ef84dc89758f9cd81a11c82`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:31.743467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.844974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 868/1756] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:31.887844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7feebc9-8aa1-44e1-8364-e7fed9c065d3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:31.892970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:31.901497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:31.901497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:31.901735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:31.912178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:31.913721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:31.926820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:31.929203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:31.941444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 889/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:32.026707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043d99-248d-47fe-900a-14df8d8108b7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:32.035632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:32.036736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:32.037002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:32.037466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:32.041864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:32.106417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:32.156130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:32.157977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:32.190170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 869/1758] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:32.354914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:32.356697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:32.375407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fb1b0-6127-41de-8b6e-c9890da97b4b service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:32.382348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:32.383668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:32.383956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:32.384470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] PATH_INFO: `/v3/projects/d6c2e7caf1fd458aa24ec1e031c39dd2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:32.385885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c2e7caf1fd458aa24ec1e031c39dd2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:32.404676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:32.487829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c2e7caf1fd458aa24ec1e031c39dd2', 'request_id': 'req-9454d5b3-c789-4c17-85c8-9ed1f630829c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.492566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:32.503766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c2e7caf1fd458aa24ec1e031c39dd2', 'request_id': 'req-9454d5b3-c789-4c17-85c8-9ed1f630829c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.517485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c2e7caf1fd458aa24ec1e031c39dd2', 'request_id': 'req-9454d5b3-c789-4c17-85c8-9ed1f630829c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.539225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] The token cache is being invalidate because project d6c2e7caf1fd458aa24ec1e031c39dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:32.539362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.540085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.542353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 890/1759] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:32 2022] DELETE /identity/v3/projects/d6c2e7caf1fd458aa24ec1e031c39dd2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:32.547687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:32.578107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1e0ed-9ac0-46aa-a3b9-6fec77490c6c service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:32.706136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:32.706703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:32.706827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:32.707115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:32.707389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] PATH_INFO: `/v3/users/43f26d74d69b4f1a87523b8a25e1e611` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:32.708795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:32.708935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f26d74d69b4f1a87523b8a25e1e611)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:32.711426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:32.772625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f26d74d69b4f1a87523b8a25e1e611'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.781849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f26d74d69b4f1a87523b8a25e1e611'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.782968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f26d74d69b4f1a87523b8a25e1e611'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.783890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f26d74d69b4f1a87523b8a25e1e611'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.792618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f26d74d69b4f1a87523b8a25e1e611'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:32.798053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454d5b3-c789-4c17-85c8-9ed1f630829c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:32.802561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:32.803193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:32.803521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:32.803798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:32.805679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:32.821359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 870/1760] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:32 2022] DELETE /identity/v3/users/43f26d74d69b4f1a87523b8a25e1e611 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:32.922024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:32.926329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:32.961293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 891/1761] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:33.029612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:33.031909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:33.126945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:33.160303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb5fac-10ca-4237-8229-769dee1ccb04 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:33.164420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:33.165140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.165429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.166660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.169077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:33.267277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:33.269235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca774ef-ae1d-4e14-8427-98d3811ebeb8 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:33.282023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 871/1762] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:33.288261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:33.289972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:33.347549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6a0a-64f7-4994-b469-a961b9067f24 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:33.460211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:33.461327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.461865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.462377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] PATH_INFO: `/v3/projects/cc9cc23e6ba14ca59a3a1f1294fb59ac` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.464992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9cc23e6ba14ca59a3a1f1294fb59ac)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:33.468540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:33.514414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:33.536531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9cc23e6ba14ca59a3a1f1294fb59ac', 'request_id': 'req-e3c8c201-ddcf-4e32-bbbe-264d409663d9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:33.547480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9cc23e6ba14ca59a3a1f1294fb59ac', 'request_id': 'req-e3c8c201-ddcf-4e32-bbbe-264d409663d9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:33.566550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9cc23e6ba14ca59a3a1f1294fb59ac', 'request_id': 'req-e3c8c201-ddcf-4e32-bbbe-264d409663d9'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:33.579147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] The token cache is being invalidate because project cc9cc23e6ba14ca59a3a1f1294fb59ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:33.579591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:33.580907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3c8c201-ddcf-4e32-bbbe-264d409663d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:33.587230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 892/1763] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:33 2022] DELETE /identity/v3/projects/cc9cc23e6ba14ca59a3a1f1294fb59ac => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:33.589057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.589631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.589751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.626520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:33.628573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:33.712020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 872/1764] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:33.716228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.718814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.719177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.746506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:33.747691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:33.759913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 893/1765] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:33.761798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:33.772670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21aeb4-eceb-40fd-94e7-526b0f1c17da None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:33.777408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:33.778017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.778303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.778686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.779333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:33.779681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:33.782305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:33.800596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 873/1766] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:33.802095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:33.813045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98d1d2-756a-4453-8004-ebcc5d7f0c4a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:33.818212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:33.818829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.819109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.819383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.820085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:33.822279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:33.880202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 894/1767] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:33 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:33.883387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:33.894789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d8ab-9f66-499f-ad9e-d4e487ac34f1 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:33.982991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:33.984140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:33.984495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:33.984825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:33.985812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:33.987404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:34.016900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 874/1768] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:33 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:34.022565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:34.034472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ce1f6-b0ad-48c8-bac2-ce7611ec0083 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:34.058080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:34.059016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:34.059464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:34.059758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:34.060622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:34.063494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:34.080283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 895/1769] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:34.082015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:34.094029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673aff4-e561-47e1-bbeb-2c11765f3b3d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:34.101477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd960-c4be-450a-92e4-f19c17f6de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:34.102091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd960-c4be-450a-92e4-f19c17f6de4a admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:34.102492 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd960-c4be-450a-92e4-f19c17f6de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:34.102774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd960-c4be-450a-92e4-f19c17f6de4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:34.103510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd960-c4be-450a-92e4-f19c17f6de4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:34.105152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd960-c4be-450a-92e4-f19c17f6de4a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:34.120184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 875/1770] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:34.123113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:34.133775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047a33d-bf04-41b6-91c6-f2900d91a2b8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:34.140663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:34.141368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:34.141703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:34.141950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] PATH_INFO: `/v3/projects/27b4bacc613046aca08d411ed4c5d755/users/656db3e5af59447aa5557ea0fc514e5f/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:34.165395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b4bacc613046aca08d411ed4c5d755, user_id=656db3e5af59447aa5557ea0fc514e5f, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:34.168583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:34.182674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 896/1771] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:34 2022] PUT /identity/v3/projects/27b4bacc613046aca08d411ed4c5d755/users/656db3e5af59447aa5557ea0fc514e5f/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:34.197740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:34.197740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:34.198044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:34.209661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:34.232174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] MFA Rules not processed for user `656db3e5af59447aa5557ea0fc514e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:34.233472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:34.334811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:34.336939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:34.349872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 876/1772] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:34.363738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:34.365549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:34.407057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679c1d1-8d2c-483b-9e2b-400bcc2aaa35 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:34.412032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:34.412657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:34.412933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:34.413205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:34.415403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:34.428889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798153e0-8bc4-48d2-8bdd-10f3724b0d79 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:34.432793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:34.433289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:34.433628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:34.433835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:34.443416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:34.444959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:34.454766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 877/1773] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:34.489303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:34.491029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:34.502802 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 897/1774] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:35.376366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:35.387202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50143d4-52b7-45f3-9718-ef9ca2d442e7 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:35.391761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:35.392414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:35.392694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:35.393036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:35.394985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:35.463227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:35.465204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfbf4b-ed9e-43bd-9fcd-7ab357da4b98 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:35.476864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 878/1775] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:36.201175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:36.203231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:36.229839 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:36.296993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c689e7-2cdb-455b-afa9-f22bd87eb9a6 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:36.301716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:36.302352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:36.302617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:36.303060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] PATH_INFO: `/v3/users/8075d09b5e1542388ca70bceab6bec0a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:36.304473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8075d09b5e1542388ca70bceab6bec0a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:36.306708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:36.373130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8075d09b5e1542388ca70bceab6bec0a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:36.380549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8075d09b5e1542388ca70bceab6bec0a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:36.381629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8075d09b5e1542388ca70bceab6bec0a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:36.382452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8075d09b5e1542388ca70bceab6bec0a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:36.393048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8075d09b5e1542388ca70bceab6bec0a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:36.418774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 898/1776] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:36 2022] DELETE /identity/v3/users/8075d09b5e1542388ca70bceab6bec0a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:36.423555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:36.424039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:36.424169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:36.444256 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:36.445458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:36.471829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:36.510113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 879/1777] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:36.520283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:36.521731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:36.585310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a45d1-89e1-4870-b403-60f1ddfbe2f4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:36.589151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:36.589750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:36.590027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:36.590295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:36.600712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:36.602155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:36.612239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 899/1778] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:36.938844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:36.941212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:36.966403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe7dff-e740-4bc4-9fac-7262e411a28b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:36.972421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:36.973182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:36.973535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:36.973924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] PATH_INFO: `/v3/projects/5d60b9ced63f4cdd92451fbb4aa8cf7f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:36.975135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d60b9ced63f4cdd92451fbb4aa8cf7f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:36.977352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:37.032267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d60b9ced63f4cdd92451fbb4aa8cf7f', 'request_id': 'req-a454b310-7e9d-4654-94d3-03c0eda84773'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.040765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d60b9ced63f4cdd92451fbb4aa8cf7f', 'request_id': 'req-a454b310-7e9d-4654-94d3-03c0eda84773'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.048318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d60b9ced63f4cdd92451fbb4aa8cf7f', 'request_id': 'req-a454b310-7e9d-4654-94d3-03c0eda84773'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.061133 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] The token cache is being invalidate because project 5d60b9ced63f4cdd92451fbb4aa8cf7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:37.061476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.062788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.064327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 880/1779] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:36 2022] DELETE /identity/v3/projects/5d60b9ced63f4cdd92451fbb4aa8cf7f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:37.068325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:37.078426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf59a6-b6d3-46a7-bd9e-c73917d7a672 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:37.111161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:37.144959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:37.145686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:37.146041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:37.146333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] PATH_INFO: `/v3/users/6691dc67299641cb85084d14f79722b0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:37.147522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6691dc67299641cb85084d14f79722b0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:37.149555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:37.234393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6691dc67299641cb85084d14f79722b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.243999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6691dc67299641cb85084d14f79722b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.244667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6691dc67299641cb85084d14f79722b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.245305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6691dc67299641cb85084d14f79722b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.254600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6691dc67299641cb85084d14f79722b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:37.285584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 900/1780] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:37 2022] DELETE /identity/v3/users/6691dc67299641cb85084d14f79722b0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:37.792507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:37.795190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:37.830879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454b310-7e9d-4654-94d3-03c0eda84773 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:37.941278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:37.942224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:37.942745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:37.943160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] PATH_INFO: `/v3/projects/6f5765c03142419dbd46ab6b09637273` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:37.944976 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f5765c03142419dbd46ab6b09637273)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:37.948253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:38.036561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f5765c03142419dbd46ab6b09637273', 'request_id': 'req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.066991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f5765c03142419dbd46ab6b09637273', 'request_id': 'req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.068366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:38.084545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f5765c03142419dbd46ab6b09637273', 'request_id': 'req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.107768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] The token cache is being invalidate because project 6f5765c03142419dbd46ab6b09637273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:38.108933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.122347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.124500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 881/1781] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:37 2022] DELETE /identity/v3/projects/6f5765c03142419dbd46ab6b09637273 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:38.128697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:38.130656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:38.188300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76dfa-868f-45f8-9454-8677d0a70174 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:38.311230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:38.314467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:38.315641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:38.316203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] PATH_INFO: `/v3/users/98649eccd9ee43f98b3885012b850664` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:38.317796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98649eccd9ee43f98b3885012b850664)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:38.320273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:38.429403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98649eccd9ee43f98b3885012b850664'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.441157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:38.445252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98649eccd9ee43f98b3885012b850664'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.446495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98649eccd9ee43f98b3885012b850664'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.448664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98649eccd9ee43f98b3885012b850664'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.474052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98649eccd9ee43f98b3885012b850664'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:38.534100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 901/1782] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:38 2022] DELETE /identity/v3/users/98649eccd9ee43f98b3885012b850664 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:39.173105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:39.178132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:39.194880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4d71b-7fcc-4e08-9eec-e1d273b280ef admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:39.213300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:39.215033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:39.339609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:39.340299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.340589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.340869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] PATH_INFO: `/v3/users/08984eb64e1c442a930c6afea2564aac` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.342728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08984eb64e1c442a930c6afea2564aac)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:39.345549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:39.418733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94775741-3917-457a-96ad-aa10ed08273c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:39.425491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:39.426137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.426577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.427005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] PATH_INFO: `/v3/projects/bda335ab67524c649b59de4e1cc345b4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.428446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda335ab67524c649b59de4e1cc345b4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:39.430795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:39.452522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08984eb64e1c442a930c6afea2564aac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.462980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08984eb64e1c442a930c6afea2564aac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.464003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08984eb64e1c442a930c6afea2564aac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.464719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08984eb64e1c442a930c6afea2564aac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.474111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f4eeb722-f76f-4c1d-8e64-3c7cf59856c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08984eb64e1c442a930c6afea2564aac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.500321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda335ab67524c649b59de4e1cc345b4', 'request_id': 'req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.507345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 882/1783] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:39 2022] DELETE /identity/v3/users/08984eb64e1c442a930c6afea2564aac => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:39.512085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.512541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.512950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.519204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda335ab67524c649b59de4e1cc345b4', 'request_id': 'req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.531194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda335ab67524c649b59de4e1cc345b4', 'request_id': 'req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.536059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:39.537707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:39.549594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] The token cache is being invalidate because project bda335ab67524c649b59de4e1cc345b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:39.550070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.552367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6eb3861a-1d9c-44d6-ae42-b1adb33a5b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:39.554485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 902/1784] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:39 2022] DELETE /identity/v3/projects/bda335ab67524c649b59de4e1cc345b4 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:39.560535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796302a2-bcb1-48ac-99e3-dc42177dddcd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.560822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796302a2-bcb1-48ac-99e3-dc42177dddcd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.561248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796302a2-bcb1-48ac-99e3-dc42177dddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.585833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-796302a2-bcb1-48ac-99e3-dc42177dddcd None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:39.587080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-796302a2-bcb1-48ac-99e3-dc42177dddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:39.626346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 883/1785] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:39.640831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:39.643415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:39.654013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:39.657252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 903/1786] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:39.669167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.669687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.670175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.682054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:39.712114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:39.714363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:39.728274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 904/1787] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:39.730004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:39.740224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836badb4-5587-4d49-95f7-5ae2da61a5b8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:39.744472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d30265-be86-46fa-a922-2f9636a195f0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:39.747600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:39.748565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.749639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.750170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.754135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:39.754854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.755297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.756011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.757179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:39.757669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:39.760181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:39.769333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:39.772632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:39.786877 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 884/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:39.793999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 905/1789] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:39.799097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:39.811135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830604b2-d3cc-4241-927b-781b29777d0b service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:39.817086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:39.817735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.818015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.818291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.818956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:39.821060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:39.859904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 885/1790] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:39 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:39.863632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:39.879162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f63e4e-ef97-4835-9995-a47bd8132245 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:39.968536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:39.969222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:39.969518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:39.969794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:39.970451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:39.972425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:39.996886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 906/1791] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:39 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:40.000459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.015605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1cdf86-0ea9-4dda-9f30-e5347274410e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.022235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.022854 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.023138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.023411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.024092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.025681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.038868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 886/1792] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:40.040117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.053770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00ae1f-1229-4146-b9f3-0725e0aabccc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.058722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ecf8-ed6e-4449-babd-08acb74f4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.059357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ecf8-ed6e-4449-babd-08acb74f4ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.059675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ecf8-ed6e-4449-babd-08acb74f4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.059986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ecf8-ed6e-4449-babd-08acb74f4ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.060702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ecf8-ed6e-4449-babd-08acb74f4ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.063057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ecf8-ed6e-4449-babd-08acb74f4ae6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.074695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 907/1793] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:40.079570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.090467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37d62d-7149-485c-bc94-80d75f044231 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.096112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.096785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.097066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.097345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] PATH_INFO: `/v3/projects/89c430e24e63465cb4891ff0d68fa227/users/c4abe86ac8c0484390c7959ff83985d8/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.113445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c430e24e63465cb4891ff0d68fa227, user_id=c4abe86ac8c0484390c7959ff83985d8, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.116142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.130356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 887/1794] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:40 2022] PUT /identity/v3/projects/89c430e24e63465cb4891ff0d68fa227/users/c4abe86ac8c0484390c7959ff83985d8/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:40.143629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.143629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.143629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.178892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] MFA Rules not processed for user `c4abe86ac8c0484390c7959ff83985d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:40.180545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:40.294034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 908/1795] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:40.298461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.416998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2bc92-c522-411e-a200-7a5b8d42e5a6 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.423320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.426597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.426874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.427339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.428562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.431140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.489557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 888/1796] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:40 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:40.493505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.544167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4246f-63ef-49f9-942f-9f225d3d4dfe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.564313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.566857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:40.651936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:40.678504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.679294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:40.680288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.680575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.680856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.683971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.686190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.734842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 909/1797] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:40 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:40.736204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.738300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614407d-2853-4eaf-adaf-bfbe6f85c97c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.744644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.745424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.745987 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.746925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] PATH_INFO: `/v3/projects/e14f323ceae048d48581e9164ca0c36a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.753752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14f323ceae048d48581e9164ca0c36a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.755061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8025755-4ae1-43b5-b598-43290d37eead admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.757259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.772874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:40.773704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:40.774003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:40.774411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:40.775197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:40.777532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:40.811110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 910/1798] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:40.812339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.858061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d0fe2-caf5-43af-bdab-ec151da93889 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:40.879578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14f323ceae048d48581e9164ca0c36a', 'request_id': 'req-8c608a1a-f186-4a1b-bc6a-fae485070eb5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:40.902912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14f323ceae048d48581e9164ca0c36a', 'request_id': 'req-8c608a1a-f186-4a1b-bc6a-fae485070eb5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:40.921040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14f323ceae048d48581e9164ca0c36a', 'request_id': 'req-8c608a1a-f186-4a1b-bc6a-fae485070eb5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:40.940608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] The token cache is being invalidate because project e14f323ceae048d48581e9164ca0c36a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:40.941531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:40.942353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:40.945645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 889/1799] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:40 2022] DELETE /identity/v3/projects/e14f323ceae048d48581e9164ca0c36a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:40.946702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:40.966208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.042062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.044810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.045202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.046423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] PATH_INFO: `/v3/projects/3fc45b4bf5b34eddbbef719465e0e912/users/9b81a96c42e14db79c46be35c7ed7abc/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.088345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc45b4bf5b34eddbbef719465e0e912, user_id=9b81a96c42e14db79c46be35c7ed7abc, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.092408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.126157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 911/1800] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:40 2022] PUT /identity/v3/projects/3fc45b4bf5b34eddbbef719465e0e912/users/9b81a96c42e14db79c46be35c7ed7abc/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:41.130416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:41.140301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.153240 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c608a1a-f186-4a1b-bc6a-fae485070eb5 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:41.229323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.230089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.230498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.230892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] PATH_INFO: `/v3/users/656db3e5af59447aa5557ea0fc514e5f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.232013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656db3e5af59447aa5557ea0fc514e5f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.234033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.244825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab13797-a41a-4444-ba95-85cdbfc4ccfd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:41.252425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:41.254023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.255034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.255444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.255721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] PATH_INFO: `/v3/users/c7e64e8cc09247a7926dd0a9e458cb07` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.257248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e64e8cc09247a7926dd0a9e458cb07)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.259433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.306617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656db3e5af59447aa5557ea0fc514e5f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.321157 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e64e8cc09247a7926dd0a9e458cb07'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.325616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656db3e5af59447aa5557ea0fc514e5f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.326356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656db3e5af59447aa5557ea0fc514e5f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.327354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656db3e5af59447aa5557ea0fc514e5f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.328668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:41.330345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e64e8cc09247a7926dd0a9e458cb07'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.330515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e64e8cc09247a7926dd0a9e458cb07'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.332522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e64e8cc09247a7926dd0a9e458cb07'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.339401 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656db3e5af59447aa5557ea0fc514e5f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.343607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e64e8cc09247a7926dd0a9e458cb07'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.360978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 890/1801] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:40 2022] DELETE /identity/v3/users/656db3e5af59447aa5557ea0fc514e5f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:41.365224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:41.366662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.367060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 912/1802] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:41 2022] DELETE /identity/v3/users/c7e64e8cc09247a7926dd0a9e458cb07 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:41.372199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:41.372199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.443542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99675ad-f56e-43f4-b746-1c17ee7305b8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:41.448957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.449596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.449877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.450245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] PATH_INFO: `/v3/users/ed15ced7fae246658d754e32a5c48884` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.451561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed15ced7fae246658d754e32a5c48884)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.454326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.454481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97a25-4754-42be-b58d-f12864fc7277 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:41.461431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f66c5e-6a34-445c-a0fa-3c8edfbd57f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.462192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f66c5e-6a34-445c-a0fa-3c8edfbd57f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.462474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f66c5e-6a34-445c-a0fa-3c8edfbd57f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.463154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f66c5e-6a34-445c-a0fa-3c8edfbd57f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.463477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f66c5e-6a34-445c-a0fa-3c8edfbd57f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.473848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f66c5e-6a34-445c-a0fa-3c8edfbd57f7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.489412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 891/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:41.491278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c527ca-33fc-46f3-967e-e243e1368bf4 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.492567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c527ca-33fc-46f3-967e-e243e1368bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.493150 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c527ca-33fc-46f3-967e-e243e1368bf4 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.495445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 892/1804] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:12:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:12:41.498538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c527ca-33fc-46f3-967e-e243e1368bf4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:41.501798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-26c527ca-33fc-46f3-967e-e243e1368bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.545011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c527ca-33fc-46f3-967e-e243e1368bf4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:41.553237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.554725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.555368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.556004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] PATH_INFO: `/v3/users/c6859f506b6d4fa288ae9c1acca285cf` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.557603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6859f506b6d4fa288ae9c1acca285cf)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.561102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.567166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed15ced7fae246658d754e32a5c48884'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.576754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed15ced7fae246658d754e32a5c48884'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.582988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed15ced7fae246658d754e32a5c48884'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.583754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed15ced7fae246658d754e32a5c48884'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.593704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3f33873e-702c-4039-9ed9-4d802b1c3cbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed15ced7fae246658d754e32a5c48884'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.625307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 913/1805] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:41 2022] DELETE /identity/v3/users/ed15ced7fae246658d754e32a5c48884 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:41.626850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bd591-a516-4dc2-922d-9973a98bacc3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.627295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bd591-a516-4dc2-922d-9973a98bacc3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.627606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bd591-a516-4dc2-922d-9973a98bacc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.668719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6859f506b6d4fa288ae9c1acca285cf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.679706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6859f506b6d4fa288ae9c1acca285cf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.680734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6859f506b6d4fa288ae9c1acca285cf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.681773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6859f506b6d4fa288ae9c1acca285cf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.684536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fa1bd591-a516-4dc2-922d-9973a98bacc3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:41.686052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fa1bd591-a516-4dc2-922d-9973a98bacc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.697349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6859f506b6d4fa288ae9c1acca285cf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:41.721614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:41.731011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 893/1806] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:41 2022] DELETE /identity/v3/users/c6859f506b6d4fa288ae9c1acca285cf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:41.732994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:41.736053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.801035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:41.836416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 914/1807] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:41.838160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.838648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.839098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.866396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a537b0-9e9e-4e05-8904-42b1ff4ef735 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:41.872312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18b69-d81c-42a9-b484-b64fafc91ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:41.872995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18b69-d81c-42a9-b484-b64fafc91ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.873387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18b69-d81c-42a9-b484-b64fafc91ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.875992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18b69-d81c-42a9-b484-b64fafc91ea0 admin admin] PATH_INFO: `/v3/projects/3fc45b4bf5b34eddbbef719465e0e912/users/9b81a96c42e14db79c46be35c7ed7abc/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.878263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18b69-d81c-42a9-b484-b64fafc91ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc45b4bf5b34eddbbef719465e0e912, user_id=9b81a96c42e14db79c46be35c7ed7abc, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:41.886565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18b69-d81c-42a9-b484-b64fafc91ea0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:41.894270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:41.895592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.908310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 894/1808] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:41 2022] PUT /identity/v3/projects/3fc45b4bf5b34eddbbef719465e0e912/users/9b81a96c42e14db79c46be35c7ed7abc/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:41.912813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:41.915494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:41.916176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:41.945212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:41.947990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:41.997824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 915/1809] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:12:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:41.998625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.000682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.032875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 895/1810] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:42.040923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.042440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.096141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506664f1-9dfc-4e60-ac40-02caf81f56e5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.101029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.101700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.101987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.102264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] PATH_INFO: `/v3/projects/811bd1d7b0994696a38853d6d241466d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.103386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811bd1d7b0994696a38853d6d241466d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.105355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.108790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a5afc-b84d-43c5-b75d-16f2d0909bf2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.112411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e67d-8ea4-4126-8535-6269117114eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.113271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e67d-8ea4-4126-8535-6269117114eb service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.113549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e67d-8ea4-4126-8535-6269117114eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.113820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e67d-8ea4-4126-8535-6269117114eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.124422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e67d-8ea4-4126-8535-6269117114eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.125868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e67d-8ea4-4126-8535-6269117114eb service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.136520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 896/1811] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:42.137812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.138104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.138442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.164432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811bd1d7b0994696a38853d6d241466d', 'request_id': 'req-2ab3bd5c-3441-499b-96d1-791db6a52177'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.173248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811bd1d7b0994696a38853d6d241466d', 'request_id': 'req-2ab3bd5c-3441-499b-96d1-791db6a52177'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.174051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] MFA Rules not processed for user `9b81a96c42e14db79c46be35c7ed7abc`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:42.175469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.184199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811bd1d7b0994696a38853d6d241466d', 'request_id': 'req-2ab3bd5c-3441-499b-96d1-791db6a52177'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.200345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] The token cache is being invalidate because project 811bd1d7b0994696a38853d6d241466d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:42.200743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.201386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2ab3bd5c-3441-499b-96d1-791db6a52177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.203684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 916/1812] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:41 2022] DELETE /identity/v3/projects/811bd1d7b0994696a38853d6d241466d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:42.204694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ca435-7702-472d-99f5-62de604e9f59 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.204973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ca435-7702-472d-99f5-62de604e9f59 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.205253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ca435-7702-472d-99f5-62de604e9f59 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.208205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 917/1813] 10.222.0.20 () {54 vars in 961 bytes} [Mon Oct 17 03:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:12:42.211650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ca435-7702-472d-99f5-62de604e9f59 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.212598 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e2ca435-7702-472d-99f5-62de604e9f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.214044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:42.239657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:42.279543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 897/1814] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:42.280923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.284589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.302942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ca435-7702-472d-99f5-62de604e9f59 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.316542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.317206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.317592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.317755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] PATH_INFO: `/v3/projects/8312b0b7c0bc4ff9823b2be972a36500` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.318905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8312b0b7c0bc4ff9823b2be972a36500)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.322082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.375666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fade4b-621f-4890-a391-41463a85a205 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.382438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8312b0b7c0bc4ff9823b2be972a36500', 'request_id': 'req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.392625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8312b0b7c0bc4ff9823b2be972a36500', 'request_id': 'req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.400939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8312b0b7c0bc4ff9823b2be972a36500', 'request_id': 'req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.415586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] The token cache is being invalidate because project 8312b0b7c0bc4ff9823b2be972a36500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:42.415902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.416771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.422987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 918/1815] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:42 2022] DELETE /identity/v3/projects/8312b0b7c0bc4ff9823b2be972a36500 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:42.422987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.422987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.440823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.441975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.442246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.442589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.446013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.505927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2c94a-6a43-42c2-aa8a-4e6d42e0fae6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.510664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.511451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.511987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.512263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] PATH_INFO: `/v3/users/a579c039d5174683a792658c956e0100` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.513460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a579c039d5174683a792658c956e0100)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.515999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.536524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.538106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402a7ad-c062-4e99-b2ea-58259adc4a10 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.552400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 898/1816] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:42.556818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ffe9-b84a-4828-abe2-9b95babbf21d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.556818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ffe9-b84a-4828-abe2-9b95babbf21d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.556818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7ffe9-b84a-4828-abe2-9b95babbf21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.582901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4eb7ffe9-b84a-4828-abe2-9b95babbf21d None None] MFA Rules not processed for user `e2e2fbc7539a421f909f96d224953867`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:42.584916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4eb7ffe9-b84a-4828-abe2-9b95babbf21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.588843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a579c039d5174683a792658c956e0100'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.591277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:42.599527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a579c039d5174683a792658c956e0100'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.601368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a579c039d5174683a792658c956e0100'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.602166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a579c039d5174683a792658c956e0100'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.610617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a579c039d5174683a792658c956e0100'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.633958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:42.634155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 919/1817] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:42 2022] DELETE /identity/v3/users/a579c039d5174683a792658c956e0100 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:42.635015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.636608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.708716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 899/1818] 10.222.0.20 () {58 vars in 1058 bytes} [Mon Oct 17 03:12:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:42.710509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.710935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.711218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.733070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec93df-1b20-45b5-8052-6a05e38313b1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.737696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:42.739693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.741151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.741896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.742527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.742914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.746317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.851638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 900/1819] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:42.851638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.851638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:42.862659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.862778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efe4cb-34af-4e9a-9dfb-48099e2ce210 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:42.865037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.867907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:42.868555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:42.868840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:42.869117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] PATH_INFO: `/v3/projects/27b4bacc613046aca08d411ed4c5d755` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:42.870370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b4bacc613046aca08d411ed4c5d755)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:42.872499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:42.884967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 920/1820] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:42.886679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:42.934233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b4bacc613046aca08d411ed4c5d755', 'request_id': 'req-fa27a880-fb6f-4605-bc2d-01c0201d7200'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.947117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b4bacc613046aca08d411ed4c5d755', 'request_id': 'req-fa27a880-fb6f-4605-bc2d-01c0201d7200'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.967487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b4bacc613046aca08d411ed4c5d755', 'request_id': 'req-fa27a880-fb6f-4605-bc2d-01c0201d7200'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:42.996364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6978eaf-5e41-4b67-88b5-052db4795a71 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.006832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] The token cache is being invalidate because project 27b4bacc613046aca08d411ed4c5d755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:43.007046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.010509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-fa27a880-fb6f-4605-bc2d-01c0201d7200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.012266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 901/1821] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:42 2022] DELETE /identity/v3/projects/27b4bacc613046aca08d411ed4c5d755 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:43.017739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:43.019319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.019694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.020000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.074347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:43.076344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.105639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.106510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.125061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.125424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.130420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.143618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.145568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8fba5-2e4f-4337-acc8-ea7449981003 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.155668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:43.157179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 921/1822] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:43.158513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b315d-98de-4dae-877d-5331ca576359 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.158862 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b315d-98de-4dae-877d-5331ca576359 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.159221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b315d-98de-4dae-877d-5331ca576359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.187369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-426b315d-98de-4dae-877d-5331ca576359 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:43.188937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-426b315d-98de-4dae-877d-5331ca576359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.197624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 902/1823] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:43.200580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.206259 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.224191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59836f87-4f0b-48c4-8e41-f3f8931df8b9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.227548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 922/1824] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:43.228616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b315d-98de-4dae-877d-5331ca576359 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.235444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.236612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.237102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.237581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] PATH_INFO: `/v3/projects/ac4beaf1f7b44210b4d3cc21a83c34b5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.239207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4beaf1f7b44210b4d3cc21a83c34b5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.241548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b315d-98de-4dae-877d-5331ca576359 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.244809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.250123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.250751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.251051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.251314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.251993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:43.253410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.255840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.281896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 923/1825] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:43.287925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.290218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.312289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9bcef-4140-4a6d-8f09-15d6de8c4020 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.333160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4beaf1f7b44210b4d3cc21a83c34b5', 'request_id': 'req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.343343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4beaf1f7b44210b4d3cc21a83c34b5', 'request_id': 'req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.353729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4beaf1f7b44210b4d3cc21a83c34b5', 'request_id': 'req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.370158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] The token cache is being invalidate because project ac4beaf1f7b44210b4d3cc21a83c34b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:43.370468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.371215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4ab62aaa-ca0f-4fa8-b09e-39805e22e0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.375956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 903/1826] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:43 2022] DELETE /identity/v3/projects/ac4beaf1f7b44210b4d3cc21a83c34b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:43.381251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.381545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.381824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.391534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.392183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.392476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.393619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] PATH_INFO: `/v3/projects/709a0b7109a74828b79f8078741c4d25` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.395266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709a0b7109a74828b79f8078741c4d25)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.397846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.410773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:43.411611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.421142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 904/1827] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:43.421820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.423335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.437386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc51a8-d090-43e4-b063-3001d3fc76b1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.442633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.443264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.443546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.443825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.444591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.446528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.485325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 905/1828] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:43.485325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.485325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.492870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709a0b7109a74828b79f8078741c4d25', 'request_id': 'req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.502737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709a0b7109a74828b79f8078741c4d25', 'request_id': 'req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.510817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709a0b7109a74828b79f8078741c4d25', 'request_id': 'req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.523293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] The token cache is being invalidate because project 709a0b7109a74828b79f8078741c4d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:43.523593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.528633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.533017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 924/1829] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:43 2022] DELETE /identity/v3/projects/709a0b7109a74828b79f8078741c4d25 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:43.534228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.535907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.569406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:43.583740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb4492-c01b-4463-83ef-21ccb57587f6 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.588778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.589649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.589842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.590163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] PATH_INFO: `/v3/users/d13f8c419416498aae0a6da65127bed5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.591333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13f8c419416498aae0a6da65127bed5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.593559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.623573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1e49f-5ed9-4dd5-8f56-2436ce2f38a5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.636147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.636777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.637060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.637442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.637965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:43.638582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.646679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.662527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:43.664638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13f8c419416498aae0a6da65127bed5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.679826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 925/1830] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:43.680136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13f8c419416498aae0a6da65127bed5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.681155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.681275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13f8c419416498aae0a6da65127bed5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.682118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13f8c419416498aae0a6da65127bed5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.683244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.695327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-006ac4da-3227-47ec-b14b-f5e0cf0b759e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13f8c419416498aae0a6da65127bed5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.704917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878bfaf-c5d5-452f-be1f-191ce8ca9bff admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.713788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.714510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.714974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.715278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.716469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.721000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 906/1831] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:43 2022] DELETE /identity/v3/users/d13f8c419416498aae0a6da65127bed5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:43.721000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049433-b210-4611-8b14-969eec20d389 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.721000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049433-b210-4611-8b14-969eec20d389 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.721382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.721936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39049433-b210-4611-8b14-969eec20d389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.749641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-39049433-b210-4611-8b14-969eec20d389 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:43.751641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-39049433-b210-4611-8b14-969eec20d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.762570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 926/1832] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/users => generated 296 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:43.762570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.763100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.778325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377ba8f-342f-4fa0-b848-74723b697c53 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.838088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 907/1833] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:43.839510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049433-b210-4611-8b14-969eec20d389 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.849835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39049433-b210-4611-8b14-969eec20d389 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.856264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.856999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.857293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.857570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.858739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.860413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.862584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c98780-8985-4717-86ce-956cec1f214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.863090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c98780-8985-4717-86ce-956cec1f214b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.863359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c98780-8985-4717-86ce-956cec1f214b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.863981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c98780-8985-4717-86ce-956cec1f214b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.864298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c98780-8985-4717-86ce-956cec1f214b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.866260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c98780-8985-4717-86ce-956cec1f214b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.873541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 908/1834] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:43.874763 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:43.876376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.891173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c8279d-2b04-4d49-975c-9b73a10d28d4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:43.897053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:43.897635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.897919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.898196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] PATH_INFO: `/v3/users/c4abe86ac8c0484390c7959ff83985d8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.899356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4abe86ac8c0484390c7959ff83985d8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:43.901551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:43.909669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 927/1835] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:43.911407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:43.912018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:43.912476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:43.944950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:43.946574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:43.971853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4abe86ac8c0484390c7959ff83985d8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.979733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4abe86ac8c0484390c7959ff83985d8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.980741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4abe86ac8c0484390c7959ff83985d8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.982090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4abe86ac8c0484390c7959ff83985d8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:43.995380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4abe86ac8c0484390c7959ff83985d8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:44.016753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 909/1836] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:43 2022] DELETE /identity/v3/users/c4abe86ac8c0484390c7959ff83985d8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:44.017807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.019283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.025896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 928/1837] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:44.026767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.028126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.049877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d59191-7711-4998-9254-7ded9f47bd63 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.058210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:44.089507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:44.114707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b865e5-c288-4541-926c-c6b55483fd55 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.119530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297a100-6f00-47e6-ac93-5f8b06679c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.120342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a100-6f00-47e6-ac93-5f8b06679c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.121435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a100-6f00-47e6-ac93-5f8b06679c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.121722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297a100-6f00-47e6-ac93-5f8b06679c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.122363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297a100-6f00-47e6-ac93-5f8b06679c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.124638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297a100-6f00-47e6-ac93-5f8b06679c8c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.134533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.135454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.135622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 910/1838] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:44.135738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.135863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.136560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.136737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.137028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.137302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.138498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.159604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:44.164332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.164491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 929/1839] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:44.164491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.171887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0141dda-e22f-4ad5-8174-0f22863044db admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.172423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 911/1840] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:44.176528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.176833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.177491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.177718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.177931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.178023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.178626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:44.178928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.180561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.192543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb607a-8021-4a63-9f97-91cafcd31797 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.199738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 930/1841] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:44.199972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.200090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.200180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.200180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.200180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] PATH_INFO: `/v3/projects/37eeb38268f34efdb14d89ca1348a58d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.200180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=37eeb38268f34efdb14d89ca1348a58d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.201655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.208374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825f12c-b75f-4c32-9362-4f037c0d5e59 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.213285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.214295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.214576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.214848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] PATH_INFO: `/v3/projects/664e6d150ab34e47acae6eaa15414bb7/users/1f4cfde8f1cd4c8bb071ae174fba8b8a/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.234955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664e6d150ab34e47acae6eaa15414bb7, user_id=1f4cfde8f1cd4c8bb071ae174fba8b8a, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.237702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.251102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37eeb38268f34efdb14d89ca1348a58d', 'request_id': 'req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:44.252184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 931/1842] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:44 2022] PUT /identity/v3/projects/664e6d150ab34e47acae6eaa15414bb7/users/1f4cfde8f1cd4c8bb071ae174fba8b8a/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:44.252992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.262177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37eeb38268f34efdb14d89ca1348a58d', 'request_id': 'req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:44.273814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37eeb38268f34efdb14d89ca1348a58d', 'request_id': 'req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:44.285333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] The token cache is being invalidate because project 37eeb38268f34efdb14d89ca1348a58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:44.285813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:44.290954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:44.290954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 912/1843] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:44 2022] DELETE /identity/v3/projects/37eeb38268f34efdb14d89ca1348a58d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:44.290954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.292752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.316520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000febb4-14a0-4102-acff-f9e5596f94c2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.321229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.321865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.322143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.322449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.323092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.324755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.340619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 932/1844] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:44.340619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.340619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.353634 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d9f0b-350a-4156-9e7d-25323d015f11 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.357493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4df3da-f85e-4291-81d2-a8c95f9f35bf admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.362520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc1ff5-9e8e-46c1-a182-0033dc092e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.363438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1ff5-9e8e-46c1-a182-0033dc092e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.363739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1ff5-9e8e-46c1-a182-0033dc092e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.364132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc1ff5-9e8e-46c1-a182-0033dc092e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.364678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc1ff5-9e8e-46c1-a182-0033dc092e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.366584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc1ff5-9e8e-46c1-a182-0033dc092e20 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.397743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 933/1845] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:44.399311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce287543-6c10-4480-932b-4516175476ab None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.399702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce287543-6c10-4480-932b-4516175476ab None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.400007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce287543-6c10-4480-932b-4516175476ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.419179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ce287543-6c10-4480-932b-4516175476ab None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:44.421002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ce287543-6c10-4480-932b-4516175476ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.422131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.422795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.423087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.423508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.425395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.438219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:44.440783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.442595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5ce8f-0bb4-4c39-84f0-5ab1a26e81ec service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.458921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 913/1846] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:44.460306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.460679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.460946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.477653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:44.484099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:44.485512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.501739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 934/1847] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:44.502677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce287543-6c10-4480-932b-4516175476ab None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.504148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ce287543-6c10-4480-932b-4516175476ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.517011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce287543-6c10-4480-932b-4516175476ab None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.522232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.522848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.523127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.523399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.524072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.525680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.540489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 935/1848] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:44.541527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.553857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c78514-f6b5-4eff-a375-65cbdd5285f6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.559861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.560720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.561104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.561944 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.562604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.564601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.571998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 914/1849] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:44.571998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.571998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.609702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 936/1850] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/users => generated 294 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:44.610577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.624669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839e7e-7c69-42dd-8cb2-c9ef40147be7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.630929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f46c8-bc05-4ebb-8901-84923aa536c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.631995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f46c8-bc05-4ebb-8901-84923aa536c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.632281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f46c8-bc05-4ebb-8901-84923aa536c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.632649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f46c8-bc05-4ebb-8901-84923aa536c5 admin admin] PATH_INFO: `/v3/projects/1ed3aa1ffc4b42f7aff259a5eba7bf97/users/8e8172d3194e474997f25c25892c31ac/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.656228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f46c8-bc05-4ebb-8901-84923aa536c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed3aa1ffc4b42f7aff259a5eba7bf97, user_id=8e8172d3194e474997f25c25892c31ac, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.659659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f46c8-bc05-4ebb-8901-84923aa536c5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.673646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a80f7e-00dd-405a-b169-ecf67b903f7a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.683651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.684327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.684610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.684890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.685666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 937/1851] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:44 2022] PUT /identity/v3/projects/1ed3aa1ffc4b42f7aff259a5eba7bf97/users/8e8172d3194e474997f25c25892c31ac/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:44.687503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7821e9-4540-45e4-950c-aa035d291471 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.687795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7821e9-4540-45e4-950c-aa035d291471 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.689977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7821e9-4540-45e4-950c-aa035d291471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.719546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.722381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.725565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1f7821e9-4540-45e4-950c-aa035d291471 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:44.734550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1f7821e9-4540-45e4-950c-aa035d291471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.734891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 915/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:44.741964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.760073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505ee5-187d-4456-8c1b-8e119a1eb235 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.831476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 938/1853] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:44.833741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.834316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.835132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.860221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:44.861574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:44.869593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.870292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.870646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.870991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.871903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.872034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 939/1854] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:44.874149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.876275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.887694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ef9c-9f64-4479-a41a-1ecf1ef26bd7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.891737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 916/1855] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:44.892673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.893609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.894189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.894593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.894936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.895778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:44.896204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.898050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.917329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 940/1856] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:44.917329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.932048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981d07a-b360-4e5e-a8e4-6a03ab3d9579 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.942957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:44.947007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.948791 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.949605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.950114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.952022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.953719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.970418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 941/1857] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:44.971378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:44.980918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1b595-f4fd-4ffe-a396-a5eb832f250f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.983434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf816ec-b145-417f-a2fa-d40d5ba596df admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:44.986825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.987439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.987717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.988274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.991521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:44.992309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:44.992703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:44.993016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:44.993825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:44.996775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:44.998432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.000478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.011140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 917/1858] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:45.011998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.013432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.027486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b18d16-9fbc-494a-9c6c-94007db204c0 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.033125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.033774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.034419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.034551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] PATH_INFO: `/v3/projects/89c430e24e63465cb4891ff0d68fa227` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.035607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c430e24e63465cb4891ff0d68fa227)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.037541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.062319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 942/1859] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:44 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:45.063354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.125681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c430e24e63465cb4891ff0d68fa227', 'request_id': 'req-89cf8316-9470-4d8d-a2b4-25b34b500b48'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.133872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:45.141924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c430e24e63465cb4891ff0d68fa227', 'request_id': 'req-89cf8316-9470-4d8d-a2b4-25b34b500b48'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.154561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c430e24e63465cb4891ff0d68fa227', 'request_id': 'req-89cf8316-9470-4d8d-a2b4-25b34b500b48'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.161182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f3d67-1f22-4af4-8bbb-1d0ace80028e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.172420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] The token cache is being invalidate because project 89c430e24e63465cb4891ff0d68fa227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:45.173707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.174804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.177470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 918/1860] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:45 2022] DELETE /identity/v3/projects/89c430e24e63465cb4891ff0d68fa227 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:45.178631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.180481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.239060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.240277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.241323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.241897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] PATH_INFO: `/v3/projects/bd2e359440b648dcabd5aad258400446/users/ce979f1c7fdc469996993f1044a15276/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.262701 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2e359440b648dcabd5aad258400446, user_id=ce979f1c7fdc469996993f1044a15276, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.268234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.297383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 943/1861] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:45 2022] PUT /identity/v3/projects/bd2e359440b648dcabd5aad258400446/users/ce979f1c7fdc469996993f1044a15276/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:45.297383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.297383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.302625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf8316-9470-4d8d-a2b4-25b34b500b48 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.386368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7777eb-bdd8-4d16-a8a5-9bdc735febc4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.393259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.394825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.394825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.394825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] PATH_INFO: `/v3/users/9b81a96c42e14db79c46be35c7ed7abc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.397180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b81a96c42e14db79c46be35c7ed7abc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.399721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.400473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02142c-22e3-4f30-8a67-74d97022aa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.402002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02142c-22e3-4f30-8a67-74d97022aa60 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.402411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02142c-22e3-4f30-8a67-74d97022aa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.402773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02142c-22e3-4f30-8a67-74d97022aa60 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.403481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02142c-22e3-4f30-8a67-74d97022aa60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.406181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02142c-22e3-4f30-8a67-74d97022aa60 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.431516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:45.446497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 919/1862] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:45 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:45.448557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.448904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.449634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.479095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b81a96c42e14db79c46be35c7ed7abc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.492737 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b81a96c42e14db79c46be35c7ed7abc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.494195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b81a96c42e14db79c46be35c7ed7abc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.495027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b81a96c42e14db79c46be35c7ed7abc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.498082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] MFA Rules not processed for user `ce979f1c7fdc469996993f1044a15276`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:45.499365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.511514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b81a96c42e14db79c46be35c7ed7abc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:45.527544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:45.544671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 944/1863] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:45 2022] DELETE /identity/v3/users/9b81a96c42e14db79c46be35c7ed7abc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:45.546225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.548958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.595083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 920/1864] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:45.605822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.607601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.661774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb858ad-b07b-4f5b-96b9-fab6e215424a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.672474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.673108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.674231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.674519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.675400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.677066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.688011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d4b9f-ba03-42cc-b477-15e80e8492de None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.690517 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 945/1865] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:45.694732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.712447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c958ae5-8afe-4d60-aa1f-e0343249677f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.717922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.718951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.719381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.719825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.720654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.722516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.734782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 946/1866] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:12:45.739368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.755059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b76ed6-4ce8-48b4-bec5-9bc5f2c91b4b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:45.783152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fd28c-55bc-4fe5-8d17-04ddc135cd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.785354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fd28c-55bc-4fe5-8d17-04ddc135cd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.785696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fd28c-55bc-4fe5-8d17-04ddc135cd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.785912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fd28c-55bc-4fe5-8d17-04ddc135cd65 admin admin] PATH_INFO: `/v3/projects/35e488c629ec40059e8c3cd76917ed0a/users/deacbfcfeca5423b938fadc1196830e9/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.790242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:45.790965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.791772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.792140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.804781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fd28c-55bc-4fe5-8d17-04ddc135cd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e488c629ec40059e8c3cd76917ed0a, user_id=deacbfcfeca5423b938fadc1196830e9, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.808822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fd28c-55bc-4fe5-8d17-04ddc135cd65 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.847179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 947/1867] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:45 2022] PUT /identity/v3/projects/35e488c629ec40059e8c3cd76917ed0a/users/deacbfcfeca5423b938fadc1196830e9/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:45.848856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:45.849150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:45.849426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:45.897181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] MFA Rules not processed for user `deacbfcfeca5423b938fadc1196830e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:45.899053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:45.924039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:45.925493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:45.929271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:45.944537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 921/1868] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:45.952247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:45.964030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:46.007619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fa3fd-5a98-48c5-8ca0-d6f6357ff928 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.069500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 948/1869] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:46.071180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.161253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:46.162431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.163667 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.165172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.165514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] PATH_INFO: `/v3/projects/3fc45b4bf5b34eddbbef719465e0e912` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.168920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc45b4bf5b34eddbbef719465e0e912)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.174530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.201425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da42c29-b561-424c-8d70-34e67f93df71 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.214841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7a1af-f8a6-4b98-b4ec-59067ef8477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.215919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a1af-f8a6-4b98-b4ec-59067ef8477b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.216116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a1af-f8a6-4b98-b4ec-59067ef8477b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.216610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7a1af-f8a6-4b98-b4ec-59067ef8477b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.219134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7a1af-f8a6-4b98-b4ec-59067ef8477b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.223066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7a1af-f8a6-4b98-b4ec-59067ef8477b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.328303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 949/1870] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:46.329041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc45b4bf5b34eddbbef719465e0e912', 'request_id': 'req-c16c7923-d8dc-49ea-a154-10ac392bb7f7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:46.330005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f579f7-b46d-4081-8449-c50af8a09c9f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.330301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f579f7-b46d-4081-8449-c50af8a09c9f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.330577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f579f7-b46d-4081-8449-c50af8a09c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.344780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc45b4bf5b34eddbbef719465e0e912', 'request_id': 'req-c16c7923-d8dc-49ea-a154-10ac392bb7f7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:46.356370 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc45b4bf5b34eddbbef719465e0e912', 'request_id': 'req-c16c7923-d8dc-49ea-a154-10ac392bb7f7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:46.366993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d8f579f7-b46d-4081-8449-c50af8a09c9f None None] MFA Rules not processed for user `8e8172d3194e474997f25c25892c31ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:46.368716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d8f579f7-b46d-4081-8449-c50af8a09c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:46.376938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] The token cache is being invalidate because project 3fc45b4bf5b34eddbbef719465e0e912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:46.377156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:46.379427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:46.384369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 922/1871] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:45 2022] DELETE /identity/v3/projects/3fc45b4bf5b34eddbbef719465e0e912 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:46.385383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.386930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:46.494814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 950/1872] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:46.496590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.496978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.497429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.520806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c7923-d8dc-49ea-a154-10ac392bb7f7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.523136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:46.539212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:46.571770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:46.630986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39929d45-e7c5-49b6-a16e-d5f4ed596f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.631796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929d45-e7c5-49b6-a16e-d5f4ed596f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.632242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929d45-e7c5-49b6-a16e-d5f4ed596f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.632588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39929d45-e7c5-49b6-a16e-d5f4ed596f41 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.633329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929d45-e7c5-49b6-a16e-d5f4ed596f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.636035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39929d45-e7c5-49b6-a16e-d5f4ed596f41 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.668150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 951/1873] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:46.671775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.672430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 923/1874] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:46.673548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:46.674809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.675810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.675984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.723213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:46.725179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:46.738975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 924/1875] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:46.740537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.754900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ea424-4e7f-487d-b467-d5cb86d54883 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.762868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.763753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.764870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.765322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.766160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.768808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.782965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 925/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:46.785784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.799129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cbe69-288a-410b-a112-b84b9fcb99f9 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.804707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.805719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.806182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.806430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e3f36-4fd4-4990-adbe-dfa8354f05ec None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.806773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.807637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:46.808143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.809849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.816181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.817072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.817568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.820055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.827413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 926/1877] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:46.828210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.837121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.838721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.842292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16196d-0283-4776-b0a3-1ecbf71e0965 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.848304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.849069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.849354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.849633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] PATH_INFO: `/v3/projects/38db567a4e5e413f96703f53e6509872/users/9eb03c92527b4bc084feeebec12a265d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.850511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 952/1878] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:46.851993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.858996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:46.873404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de0d68-2d3a-4ab4-9174-0398fe21f0ed service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:46.880160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:46.881607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:46.883357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:46.883863 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:46.884750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.887064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.894670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38db567a4e5e413f96703f53e6509872, user_id=9eb03c92527b4bc084feeebec12a265d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:46.900970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:46.942944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 927/1879] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:46 2022] PUT /identity/v3/projects/38db567a4e5e413f96703f53e6509872/users/9eb03c92527b4bc084feeebec12a265d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:46.944865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:46.964421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 953/1880] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:46.970933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.100691 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171ef7-61bf-43e7-b6d6-241bb7645b79 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.133272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0234-3c3e-419d-b4f9-4e96a1d772e1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.139774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.140521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.140861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.141181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.142265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:47.144861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:47.179202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 954/1881] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:46 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:47.183902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.210502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b575f0-c83c-4a8f-b1d3-b83f907db3f0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.239052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.241675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.242014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.242285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.244100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:47.247858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:47.281994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 955/1882] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:47.285451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.309872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.311129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.311129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.313637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.315454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e62f1-c452-4565-9d6d-0eaaee76d1fe admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.315986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:47.319127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:47.336968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 928/1883] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:47.340137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.340788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.341430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.341710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.342501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:47.344875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:47.347811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.378850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 956/1884] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:47.381347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58de05-a8d2-44ee-84ca-399f33641561 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.383106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.386952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8b201-6d3b-40a3-9bd9-75407d55bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.389023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b201-6d3b-40a3-9bd9-75407d55bc92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.389983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b201-6d3b-40a3-9bd9-75407d55bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.390398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8b201-6d3b-40a3-9bd9-75407d55bc92 admin admin] PATH_INFO: `/v3/projects/38db567a4e5e413f96703f53e6509872/users/9eb03c92527b4bc084feeebec12a265d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.392628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8b201-6d3b-40a3-9bd9-75407d55bc92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38db567a4e5e413f96703f53e6509872, user_id=9eb03c92527b4bc084feeebec12a265d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:47.395609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8b201-6d3b-40a3-9bd9-75407d55bc92 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:47.403927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:47.413135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e926-f178-4b85-b152-3f2a69fac95f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.419674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 929/1885] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:47 2022] PUT /identity/v3/projects/38db567a4e5e413f96703f53e6509872/users/9eb03c92527b4bc084feeebec12a265d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:47.427206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.427578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.427961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.488590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] MFA Rules not processed for user `9eb03c92527b4bc084feeebec12a265d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:47.500334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:47.525485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b751a-3acf-4fb0-b5c0-6789d1f8d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.526281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b751a-3acf-4fb0-b5c0-6789d1f8d23d admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.526764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b751a-3acf-4fb0-b5c0-6789d1f8d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.527233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b751a-3acf-4fb0-b5c0-6789d1f8d23d admin admin] PATH_INFO: `/v3/projects/8989b2ca87b74898875114ddf4a31a0d/users/4744d4f25bf6454480e4d54a1a04229d/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.564819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b751a-3acf-4fb0-b5c0-6789d1f8d23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8989b2ca87b74898875114ddf4a31a0d, user_id=4744d4f25bf6454480e4d54a1a04229d, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:47.573318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b751a-3acf-4fb0-b5c0-6789d1f8d23d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:47.608835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 957/1886] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:47 2022] PUT /identity/v3/projects/8989b2ca87b74898875114ddf4a31a0d/users/4744d4f25bf6454480e4d54a1a04229d/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:47.618520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.620864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.621173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:47.682560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 930/1887] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:47.688040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] MFA Rules not processed for user `4744d4f25bf6454480e4d54a1a04229d`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:47.689307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:47.725945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.754900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:47.851909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fd55-7759-4192-bdb9-7fca4122b012 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:47.905861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 958/1888] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:47.907018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:47.908926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:47.978286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c22c53-ab23-431a-8c29-8d41e344f3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:47.979267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22c53-ab23-431a-8c29-8d41e344f3ac service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:47.979760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22c53-ab23-431a-8c29-8d41e344f3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:47.980319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c22c53-ab23-431a-8c29-8d41e344f3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:48.015210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae247a5-77fd-40ac-9504-8a1e86715ed3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:48.019489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c1d61e-9bfc-4f04-bcbe-bad5653d7a39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:48.020150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1d61e-9bfc-4f04-bcbe-bad5653d7a39 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:48.020435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1d61e-9bfc-4f04-bcbe-bad5653d7a39 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:48.020707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c1d61e-9bfc-4f04-bcbe-bad5653d7a39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:48.034354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1d61e-9bfc-4f04-bcbe-bad5653d7a39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:48.037305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c1d61e-9bfc-4f04-bcbe-bad5653d7a39 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:48.050057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 959/1889] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:48.107637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:48.120882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22c53-ab23-431a-8c29-8d41e344f3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:48.122652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c22c53-ab23-431a-8c29-8d41e344f3ac service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:48.140550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 931/1890] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:48.550854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb2692-5995-40f5-891b-b8de50dde6ed None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:48.551256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb2692-5995-40f5-891b-b8de50dde6ed None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:48.551435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb2692-5995-40f5-891b-b8de50dde6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:48.586628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f7cb2692-5995-40f5-891b-b8de50dde6ed None None] MFA Rules not processed for user `8e8172d3194e474997f25c25892c31ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:48.589215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f7cb2692-5995-40f5-891b-b8de50dde6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:48.776706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 960/1891] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:49.381424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a6ef2-01af-41ca-a7b8-448ce16db4cf None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:49.382002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a6ef2-01af-41ca-a7b8-448ce16db4cf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:49.382002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a6ef2-01af-41ca-a7b8-448ce16db4cf None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:49.384329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 932/1892] 10.222.0.20 () {54 vars in 912 bytes} [Mon Oct 17 03:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:12:49.399335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:49.400134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:49.400458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:49.465120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:49.469184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:49.634008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a6ef2-01af-41ca-a7b8-448ce16db4cf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:49.635230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 961/1893] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:12:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:49.701235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:49.705552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:49.722177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0faa3-3d5d-4461-bc58-d8f5c61d04ec None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:49.736361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2b9a-81a3-46c8-84ee-726559f7635b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:49.739690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2b9a-81a3-46c8-84ee-726559f7635b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:49.740033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2b9a-81a3-46c8-84ee-726559f7635b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:49.740327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2b9a-81a3-46c8-84ee-726559f7635b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:49.760033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a6ef2-01af-41ca-a7b8-448ce16db4cf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:49.765237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:49.765881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:49.766168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:49.766444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] PATH_INFO: `/v3/users/deacbfcfeca5423b938fadc1196830e9` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:49.767590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deacbfcfeca5423b938fadc1196830e9)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:49.769555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:49.774001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e2b9a-81a3-46c8-84ee-726559f7635b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:49.776951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e2b9a-81a3-46c8-84ee-726559f7635b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:49.789647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 962/1894] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:49.844251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deacbfcfeca5423b938fadc1196830e9'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:49.853129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deacbfcfeca5423b938fadc1196830e9'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:49.854664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deacbfcfeca5423b938fadc1196830e9'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:49.855924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deacbfcfeca5423b938fadc1196830e9'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:49.867431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deacbfcfeca5423b938fadc1196830e9'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:49.897203 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 933/1895] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:49 2022] DELETE /identity/v3/users/deacbfcfeca5423b938fadc1196830e9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:49.902415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:49.902902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:49.903568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:49.917433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:49.931464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:49.933293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:50.015057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 963/1896] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:50.030514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:50.034912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:50.134892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e2c68-4b2f-4dce-a0de-408275e3f5b4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:50.140005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc06b5-72ef-42f1-b222-301245816788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:50.140635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc06b5-72ef-42f1-b222-301245816788 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:50.141294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc06b5-72ef-42f1-b222-301245816788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:50.141294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc06b5-72ef-42f1-b222-301245816788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:50.151918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc06b5-72ef-42f1-b222-301245816788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:50.153348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc06b5-72ef-42f1-b222-301245816788 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:50.179802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 934/1897] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:50.463917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:50.466135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:50.509675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafd41ef-9305-44e8-b847-736f57cb58aa None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:50.532757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:50.539972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:50.540852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:50.541318 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] PATH_INFO: `/v3/users/6cc906c6fbf843448fa0f49daa46af0f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:50.543584 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cc906c6fbf843448fa0f49daa46af0f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:50.546714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:50.674392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cc906c6fbf843448fa0f49daa46af0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:50.712143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cc906c6fbf843448fa0f49daa46af0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:50.715001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cc906c6fbf843448fa0f49daa46af0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:50.717587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cc906c6fbf843448fa0f49daa46af0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:50.732201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cc906c6fbf843448fa0f49daa46af0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:50.797366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 964/1898] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:50 2022] DELETE /identity/v3/users/6cc906c6fbf843448fa0f49daa46af0f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:50.802136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:50.802627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:50.802831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:50.889622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:50.895015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:50.924335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:51.055091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:51.056321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:51.063696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 935/1899] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:51.078571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da621515-4a9c-4e02-981f-e6dec6be42ed admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:51.095569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:51.099283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:51.129439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:51.130205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:51.130522 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:51.130816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] PATH_INFO: `/v3/projects/35e488c629ec40059e8c3cd76917ed0a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:51.132211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e488c629ec40059e8c3cd76917ed0a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:51.136084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:51.204462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e488c629ec40059e8c3cd76917ed0a', 'request_id': 'req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.214873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8332c4-988c-4cac-b083-2400408467d0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:51.218371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e488c629ec40059e8c3cd76917ed0a', 'request_id': 'req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.235466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e488c629ec40059e8c3cd76917ed0a', 'request_id': 'req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.253219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:51.262283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] The token cache is being invalidate because project 35e488c629ec40059e8c3cd76917ed0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:51.262571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.265569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.269222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 965/1900] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:51 2022] DELETE /identity/v3/projects/35e488c629ec40059e8c3cd76917ed0a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:51.275823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:51.278044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:51.303774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:51.304361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:51.304639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:51.304911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:51.307581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:51.421416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fba3c-e0d6-49ce-ae9c-9deb208ab7ce admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:51.439662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:51.440834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:51.441336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:51.442349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] PATH_INFO: `/v3/users/9eb03c92527b4bc084feeebec12a265d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:51.446998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb03c92527b4bc084feeebec12a265d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:51.450476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:51.453414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:51.454883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:51.482820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 936/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:51.558609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb03c92527b4bc084feeebec12a265d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.571485 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb03c92527b4bc084feeebec12a265d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.572718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb03c92527b4bc084feeebec12a265d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.573819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb03c92527b4bc084feeebec12a265d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.588012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a3801475-1d46-40f3-a865-30fefa7f77bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb03c92527b4bc084feeebec12a265d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:51.647985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 966/1902] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:51 2022] DELETE /identity/v3/users/9eb03c92527b4bc084feeebec12a265d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:51.712740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:51.714287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:51.735765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea36bd3-8827-4a14-96df-1d00984f4b64 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:51.765713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:51.870189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:51.870988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:51.871454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:51.871742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] PATH_INFO: `/v3/users/77d0af96f3b7410ba009df93954bd131` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:51.873651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d0af96f3b7410ba009df93954bd131)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:51.876790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:51.996794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d0af96f3b7410ba009df93954bd131'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.009045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d0af96f3b7410ba009df93954bd131'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.009926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d0af96f3b7410ba009df93954bd131'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.010592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d0af96f3b7410ba009df93954bd131'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.024261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d0af96f3b7410ba009df93954bd131'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.068044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 937/1903] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:51 2022] DELETE /identity/v3/users/77d0af96f3b7410ba009df93954bd131 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:52.069529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.069973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.070074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.119033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:52.120289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.208397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 967/1904] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:52.233847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:52.235930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.291000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:52.292834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.328225 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382383-1fbe-4807-8496-04a5ff8b2ea1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:52.331405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:52.332116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.332402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.332677 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] PATH_INFO: `/v3/projects/b3ef256739cb476d94e7668cf96f7afa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.334028 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ef256739cb476d94e7668cf96f7afa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:52.336043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:52.387898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814c16-b51c-475f-9537-834335799799 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:52.396588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046d2f9-08f1-47a5-b03b-2c14a11d8764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:52.397709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d2f9-08f1-47a5-b03b-2c14a11d8764 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.397970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:52.398219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d2f9-08f1-47a5-b03b-2c14a11d8764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.398480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046d2f9-08f1-47a5-b03b-2c14a11d8764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.431199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d2f9-08f1-47a5-b03b-2c14a11d8764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:52.434699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046d2f9-08f1-47a5-b03b-2c14a11d8764 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:52.455105 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ef256739cb476d94e7668cf96f7afa', 'request_id': 'req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.470374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ef256739cb476d94e7668cf96f7afa', 'request_id': 'req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.473922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 938/1905] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:52.479347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5202-df5d-4cf5-9218-805052956c1c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.479347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5202-df5d-4cf5-9218-805052956c1c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.479587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b5202-df5d-4cf5-9218-805052956c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.484049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ef256739cb476d94e7668cf96f7afa', 'request_id': 'req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.507269 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] The token cache is being invalidate because project b3ef256739cb476d94e7668cf96f7afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:52.507269 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.507269 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.514760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d52b5202-df5d-4cf5-9218-805052956c1c None None] MFA Rules not processed for user `1f4cfde8f1cd4c8bb071ae174fba8b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:52.516346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 968/1906] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:52 2022] DELETE /identity/v3/projects/b3ef256739cb476d94e7668cf96f7afa => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:52.516863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d52b5202-df5d-4cf5-9218-805052956c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.517790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:52.519227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.609874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:52.721008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 939/1907] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:52.724898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237905e-013e-474a-8063-9d49b6bba7fc None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.725189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237905e-013e-474a-8063-9d49b6bba7fc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.725464 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237905e-013e-474a-8063-9d49b6bba7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.745430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae28f-0c3f-4e23-8885-e47a2d2a5a8f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:52.756254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:52.756977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.757476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.757822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] PATH_INFO: `/v3/projects/38db567a4e5e413f96703f53e6509872` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.759368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] RBAC: Authorizing `identity:delete_project(project_id=38db567a4e5e413f96703f53e6509872)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:52.761856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:52.777740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c237905e-013e-474a-8063-9d49b6bba7fc None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:52.778598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c237905e-013e-474a-8063-9d49b6bba7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.793582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 940/1908] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:52.794940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148adf-f544-4dc0-a6ab-c9c6593f6639 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:52.799666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148adf-f544-4dc0-a6ab-c9c6593f6639 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:52.800056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148adf-f544-4dc0-a6ab-c9c6593f6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:52.867989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ed148adf-f544-4dc0-a6ab-c9c6593f6639 None None] MFA Rules not processed for user `1f4cfde8f1cd4c8bb071ae174fba8b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:52.872275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ed148adf-f544-4dc0-a6ab-c9c6593f6639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:52.882992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38db567a4e5e413f96703f53e6509872', 'request_id': 'req-f7409e08-54a5-4c39-8973-1b652c51144c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.912664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38db567a4e5e413f96703f53e6509872', 'request_id': 'req-f7409e08-54a5-4c39-8973-1b652c51144c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.940113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38db567a4e5e413f96703f53e6509872', 'request_id': 'req-f7409e08-54a5-4c39-8973-1b652c51144c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:52.996977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] The token cache is being invalidate because project 38db567a4e5e413f96703f53e6509872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:52.997278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.004319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f7409e08-54a5-4c39-8973-1b652c51144c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.016785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 969/1909] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:52 2022] DELETE /identity/v3/projects/38db567a4e5e413f96703f53e6509872 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:53.018583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.019059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.019539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.069936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:53.071166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.073981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 941/1910] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:53.075288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.075576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.075853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.115305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:53.120871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.178454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:53.260695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 970/1911] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:53.260695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.271666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.307582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 942/1912] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:53.308573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.317176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.333704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270d34e-53af-4e62-a172-1461edd14e5f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:53.340757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:53.342714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.343516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.344000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] PATH_INFO: `/v3/projects/69240d0aafd34eb5bf360ee51afdef90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.345590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69240d0aafd34eb5bf360ee51afdef90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:53.348080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:53.417653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69240d0aafd34eb5bf360ee51afdef90', 'request_id': 'req-6fd60447-1706-4dda-bd43-fb28ef0f2a30'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.429615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69240d0aafd34eb5bf360ee51afdef90', 'request_id': 'req-6fd60447-1706-4dda-bd43-fb28ef0f2a30'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.455088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69240d0aafd34eb5bf360ee51afdef90', 'request_id': 'req-6fd60447-1706-4dda-bd43-fb28ef0f2a30'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.463631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90894fe6-7dd4-49f1-a196-085b25ab131e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:53.494059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:53.514423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] The token cache is being invalidate because project 69240d0aafd34eb5bf360ee51afdef90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:53.515032 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.516760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.520728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 943/1913] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:53 2022] DELETE /identity/v3/projects/69240d0aafd34eb5bf360ee51afdef90 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:53.522857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.527514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.589100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:53.590005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.590291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.590566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.594927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.647116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd60447-1706-4dda-bd43-fb28ef0f2a30 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:53.656246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:53.656986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.657269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.657600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.658322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:53.659147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:53.660578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38673-7c49-4e1f-a7a9-a4fec3e644fd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:53.695291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:53.696888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:53.702525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 944/1914] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:53.704610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.704948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.705235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.719069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 971/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:53.720432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.722730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.743459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706ae07-f6e6-4aec-a801-9fe813f1ba5c service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:53.750383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:53.751084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.751356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.751627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] PATH_INFO: `/v3/users/00e0832d3ef84dc89758f9cd81a11c82` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.767561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e0832d3ef84dc89758f9cd81a11c82)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:53.774544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:53.779050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:53.797755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:53.801556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.823769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 945/1916] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:53.824617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.836407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f768f3f-d219-4bf1-a528-421a3d8d6158 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:53.843480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:53.844134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:53.844415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:53.844716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:53.848406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:53.850738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:53.863085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e0832d3ef84dc89758f9cd81a11c82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.878427 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e0832d3ef84dc89758f9cd81a11c82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.879971 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e0832d3ef84dc89758f9cd81a11c82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.880872 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e0832d3ef84dc89758f9cd81a11c82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.886435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 946/1917] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:53 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:53.887296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.891320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:53.892734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e0832d3ef84dc89758f9cd81a11c82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:53.925391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 972/1918] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:53 2022] DELETE /identity/v3/users/00e0832d3ef84dc89758f9cd81a11c82 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:53.926691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:53.928993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:54.038424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe10c26-23da-4d08-ae71-e850e10c466a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.040290 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2318cab-41c8-44f9-a878-d11f1d8786eb admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.044279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.045566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.045871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.046176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.046877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.049147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.053084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.055689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.057251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.057634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.069265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:54.069783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.074400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.080459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 973/1919] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:53 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:54.085012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.096274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837afbf0-71b7-4100-ac29-657e18260584 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.103829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.104824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.105663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.106519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.107329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.108308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 947/1920] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:54.109920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.113011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.125329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 974/1921] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:54.129943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.151990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96420f9-4073-4ce2-b87e-c5b323f7d5bd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.188000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.189220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.192064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.192064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.193649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.199773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c6f9-0f69-438a-b2f7-4f32f3b1aadc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.200518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.205882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.206582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.207585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.207585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.208020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.209962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.244278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 975/1922] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:54.245315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.257242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b048-492a-432e-91ba-6eaac2b77497 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.262610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0851a-4984-4470-86b7-d5265a701336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.263272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0851a-4984-4470-86b7-d5265a701336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.263716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0851a-4984-4470-86b7-d5265a701336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.264138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0851a-4984-4470-86b7-d5265a701336 admin admin] PATH_INFO: `/v3/projects/1bf00c2c27c74e2cb034b41efda51fc5/users/ec426b28a2df463abf0fa4afa77dce89/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.270889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 948/1923] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:54 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:54.274911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.294577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0851a-4984-4470-86b7-d5265a701336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf00c2c27c74e2cb034b41efda51fc5, user_id=ec426b28a2df463abf0fa4afa77dce89, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.299440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0851a-4984-4470-86b7-d5265a701336 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.325498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 976/1924] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:54 2022] PUT /identity/v3/projects/1bf00c2c27c74e2cb034b41efda51fc5/users/ec426b28a2df463abf0fa4afa77dce89/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:54.337206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.338051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.338705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.350448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:54.395175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] MFA Rules not processed for user `ec426b28a2df463abf0fa4afa77dce89`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:54.396547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:54.403986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97281f1-bc05-4311-abbf-92ae775bb762 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.412709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:54.508175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 977/1925] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:54.512276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.581286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.581967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.582255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.582537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.583686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.585885 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.622192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 949/1926] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:54 2022] POST /identity/v3/users => generated 284 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:12:54.627139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.643427 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c38ca-41ac-4ece-ba21-625279eea990 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.654825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.654825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.654825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.654825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.655289 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.655655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.713850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 950/1927] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:54.717296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd6a20-b06f-4396-9cdc-88faff6e78f0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.719587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.727421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.728127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.729792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.729792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.729792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.731192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.768354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e8f52-2598-4142-a4f1-862a6be97f22 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:54.780447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 978/1928] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:54 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:54.791191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.807624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:54.810495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:54.813394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:54.814762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:54.815603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:54.818687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:54.879526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 951/1929] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:54.880434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:54.889869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:54.948516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20994dae-f19b-4d46-904f-cc9a3a344bcc admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.041333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f962c48-16b4-4bdb-bed6-eed0d11633e4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.047846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.048812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.049158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.049432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.050389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.054082 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.084926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 979/1930] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:54 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:55.085653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:55.097241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.097805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.098113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.098327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1ba73-614b-49ae-a705-4a091f21e757 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.098521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] PATH_INFO: `/v3/projects/3291936876a44899aa758295dedbabb7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.101278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3291936876a44899aa758295dedbabb7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.103418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.105645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a52822-d677-4d8e-be56-fa5f7cd0ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.106336 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52822-d677-4d8e-be56-fa5f7cd0ecf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.106606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52822-d677-4d8e-be56-fa5f7cd0ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.106880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a52822-d677-4d8e-be56-fa5f7cd0ecf0 admin admin] PATH_INFO: `/v3/projects/66d04e10517a4ab4a480963d6f7a3ae2/users/15e9c483c274477d841b0372861925c8/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.127612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a52822-d677-4d8e-be56-fa5f7cd0ecf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d04e10517a4ab4a480963d6f7a3ae2, user_id=15e9c483c274477d841b0372861925c8, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.130314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a52822-d677-4d8e-be56-fa5f7cd0ecf0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.161265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 980/1931] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:55 2022] PUT /identity/v3/projects/66d04e10517a4ab4a480963d6f7a3ae2/users/15e9c483c274477d841b0372861925c8/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:55.162703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05bdf-b85c-4ece-8d05-bd6b35577ab5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.163161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05bdf-b85c-4ece-8d05-bd6b35577ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.163606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05bdf-b85c-4ece-8d05-bd6b35577ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.182707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:55.184986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3291936876a44899aa758295dedbabb7', 'request_id': 'req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:55.193694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:55.203851 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3291936876a44899aa758295dedbabb7', 'request_id': 'req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:55.234073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3291936876a44899aa758295dedbabb7', 'request_id': 'req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:55.240753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c6f05bdf-b85c-4ece-8d05-bd6b35577ab5 None None] MFA Rules not processed for user `1f4cfde8f1cd4c8bb071ae174fba8b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:55.241676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c6f05bdf-b85c-4ece-8d05-bd6b35577ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:55.264780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] The token cache is being invalidate because project 3291936876a44899aa758295dedbabb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:12:55.265176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:55.268302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:55.275942 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 952/1932] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:12:54 2022] DELETE /identity/v3/projects/3291936876a44899aa758295dedbabb7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:55.277039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:55.278593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:55.350891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 981/1933] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:55.352466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ac3f-6778-418f-93f0-ed1723d3645b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.352899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ac3f-6778-418f-93f0-ed1723d3645b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.353819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ac3f-6778-418f-93f0-ed1723d3645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.393128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb95ec1-d08d-48d1-bcac-34e88c1f82ea admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.417802 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8228ac3f-6778-418f-93f0-ed1723d3645b None None] MFA Rules not processed for user `15e9c483c274477d841b0372861925c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:55.418766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8228ac3f-6778-418f-93f0-ed1723d3645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:55.428904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cc5f6-1a12-49a4-afb9-060424d83275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.429648 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cc5f6-1a12-49a4-afb9-060424d83275 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.430230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cc5f6-1a12-49a4-afb9-060424d83275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.430628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cc5f6-1a12-49a4-afb9-060424d83275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.431458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cc5f6-1a12-49a4-afb9-060424d83275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.437324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cc5f6-1a12-49a4-afb9-060424d83275 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.463941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 953/1934] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:55.468347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.468347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.468347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.505018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:55.506962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:55.534109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 954/1935] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:55.535106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:55.560613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1c236-f39b-482a-90e9-36996459ad85 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.606292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.608594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 982/1936] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:55.610137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.610617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.611052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.614535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.615673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.620740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] PATH_INFO: `/v3/projects/f85ce26399e243278168052ee6442ae6/users/bdb56e417b8c4df49adc8822bfef549d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.649525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:55.655095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:55.677947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85ce26399e243278168052ee6442ae6, user_id=bdb56e417b8c4df49adc8822bfef549d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.681719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.681886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 983/1937] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:55.682664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:55.687612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:55.727568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8279-7a72-4c17-8348-0a0c548afa0d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.738237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 955/1938] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:55 2022] PUT /identity/v3/projects/f85ce26399e243278168052ee6442ae6/users/bdb56e417b8c4df49adc8822bfef549d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:55.743124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:55.870251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deafc08-ba0f-4cb6-b802-b9d7a21ae19f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.887370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.891087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.891581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.892943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.894061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.895148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.895788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.896101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.896375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.897200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:12:55.897512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.899124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.913676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.956962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 956/1939] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:12:55.957764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:55.975550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a24c0-fd11-4523-8196-2a74b5e60ef5 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:55.982205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:55.982933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:55.983296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:55.983726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:55.984497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:55.986536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:55.999703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 984/1940] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:55 2022] POST /identity/v3/projects => generated 367 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:55.999703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.009120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 957/1941] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:56.009120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.026436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf957b8-844d-463a-a7f4-876cd7b166c5 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.047595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:56.088715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:56.141623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086beb-eaa2-4c43-9d35-4a2d94665c85 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.160049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.162648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.163034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.163335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.164106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.171108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.225571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.226205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.226487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.230746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.231431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.237921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.266988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 985/1942] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:55 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:56.267733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.298601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 958/1943] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:56 2022] POST /identity/v3/users => generated 290 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:56.300023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.335268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cd052-67b8-4076-a7b9-3b9e413eacda admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.432221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616e044-9b52-48c3-95ed-0adb4b6bd9d7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.444016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.444635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.444912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.445187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] PATH_INFO: `/v3/projects/f85ce26399e243278168052ee6442ae6/users/bdb56e417b8c4df49adc8822bfef549d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.469923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85ce26399e243278168052ee6442ae6, user_id=bdb56e417b8c4df49adc8822bfef549d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.474639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.476969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbb5cd-56b1-42ce-b9c8-7047c7d1a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.477762 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb5cd-56b1-42ce-b9c8-7047c7d1a974 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.478156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb5cd-56b1-42ce-b9c8-7047c7d1a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.478583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbb5cd-56b1-42ce-b9c8-7047c7d1a974 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.479708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbb5cd-56b1-42ce-b9c8-7047c7d1a974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.482149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbb5cd-56b1-42ce-b9c8-7047c7d1a974 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.529893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 986/1944] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:56 2022] PUT /identity/v3/projects/f85ce26399e243278168052ee6442ae6/users/bdb56e417b8c4df49adc8822bfef549d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:56.530930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.531420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 959/1945] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:56 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:56.534563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.534863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.535202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.598707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] MFA Rules not processed for user `bdb56e417b8c4df49adc8822bfef549d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:56.600715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:56.617844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8945a-e5f5-497e-88a2-c5eebd1955b7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.631364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.632162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.632444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.632714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.633368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.634974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.647113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 987/1946] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:56.648059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.658865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a20159-1ef4-48ab-a7fb-8a95e57f6f84 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.663566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.664217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.664495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.664764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.665394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.667034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.682546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 988/1947] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:56.682546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.704112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aee80-7f9b-4ce2-8f9a-74ad52ec4056 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.719503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.720487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.720769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.721377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] PATH_INFO: `/v3/projects/248ba3bcb26e49909f9a45f10112d4f4/users/c671e58ee5384bfe9cb5cd6519cb6782/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.778242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248ba3bcb26e49909f9a45f10112d4f4, user_id=c671e58ee5384bfe9cb5cd6519cb6782, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.787517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 960/1948] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:56.788509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.793229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.813229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:56.818518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2653b24-c5d2-4964-bff6-0884a8e2902e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.827044 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 989/1949] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:56 2022] PUT /identity/v3/projects/248ba3bcb26e49909f9a45f10112d4f4/users/c671e58ee5384bfe9cb5cd6519cb6782/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:56.827996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.829664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:56.878791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:56.949679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.950342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.950547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.950807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.951924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:56.953287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:56.967347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413102b-814d-4685-9fea-7c2eeb9673e5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:56.974145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 961/1950] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:56.975293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:56.987375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:56.988906 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:56.990021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:56.990487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:56.993885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:57.008570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370605c-be6b-4e00-a893-f6583fbb232e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:57.018593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:57.019271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.019629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.019935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.020592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:57.023532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:57.038386 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 962/1951] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:57.039252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:57.077670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b97a7-7123-46c7-a71c-72e0896465ec admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:57.095158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce2516-3167-40da-aadf-fb7134c35816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:57.098072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce2516-3167-40da-aadf-fb7134c35816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.098360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce2516-3167-40da-aadf-fb7134c35816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.099261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce2516-3167-40da-aadf-fb7134c35816 admin admin] PATH_INFO: `/v3/projects/326c543d6e3c417eaf39593b0a691fd4/users/a9dba1076d96435b9f452a7c2b93206b/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.118180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:57.119705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:57.133184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 990/1952] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:57.142822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:57.150206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce2516-3167-40da-aadf-fb7134c35816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326c543d6e3c417eaf39593b0a691fd4, user_id=a9dba1076d96435b9f452a7c2b93206b, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:57.155131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce2516-3167-40da-aadf-fb7134c35816 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:57.176277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 963/1953] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:57 2022] PUT /identity/v3/projects/326c543d6e3c417eaf39593b0a691fd4/users/a9dba1076d96435b9f452a7c2b93206b/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:57.177205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985ef1-1f7f-4bfb-ab96-c628e65af145 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:57.189859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.190621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.191118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.269372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] MFA Rules not processed for user `a9dba1076d96435b9f452a7c2b93206b`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:57.270607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:57.297041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08403878-1f90-491c-b1ec-4930d01c554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:57.297915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08403878-1f90-491c-b1ec-4930d01c554f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.299046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08403878-1f90-491c-b1ec-4930d01c554f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.299913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08403878-1f90-491c-b1ec-4930d01c554f admin admin] PATH_INFO: `/v3/projects/248ba3bcb26e49909f9a45f10112d4f4/users/c671e58ee5384bfe9cb5cd6519cb6782/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.301807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08403878-1f90-491c-b1ec-4930d01c554f admin admin] RBAC: Authorizing `identity:create_grant(project_id=248ba3bcb26e49909f9a45f10112d4f4, user_id=c671e58ee5384bfe9cb5cd6519cb6782, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:57.304934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08403878-1f90-491c-b1ec-4930d01c554f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:57.318619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 991/1954] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:57 2022] PUT /identity/v3/projects/248ba3bcb26e49909f9a45f10112d4f4/users/c671e58ee5384bfe9cb5cd6519cb6782/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:57.331344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.331634 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.331956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.364425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] MFA Rules not processed for user `c671e58ee5384bfe9cb5cd6519cb6782`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:57.365656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:57.393003 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 964/1955] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:12:57.398419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:57.413799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ad44-8fbd-4e52-b559-928cca1783e0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:57.424792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:57.526244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 992/1956] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:57.538949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:57.544590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:57.562155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:57.563955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.564949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.567292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.570928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:57.585908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:57.679585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 965/1957] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:57.685351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:57.711307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:57.794367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd54b92-061a-49f3-b61c-09951624288b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:57.901670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b75a1-a7a8-4e9b-aad2-31a0c63659ff admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:57.917707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:57.921078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.921367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.922110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.924004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:57.928264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:57.968069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:57.968387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:57.969377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:57.969498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:57.986240 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 966/1958] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:12:57 2022] POST /identity/v3/users => generated 299 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:12:57.991412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.018815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075a50-6911-4357-b9b0-bb9fb72c81df admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:58.031373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:58.033410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.034040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.034556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.035526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:58.051924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:58.082651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 967/1959] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:58.086445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.094034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:58.095531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:58.106327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce738ea3-5909-4d1e-a37a-3c416b1d7840 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:58.114218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:58.114958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.115237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.115511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] PATH_INFO: `/v3/projects/932233345a3d4c898c381c892d64a02d/users/54349308c0b545969cc523db0d2b4153/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.140736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 993/1960] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:12:58.149545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932233345a3d4c898c381c892d64a02d, user_id=54349308c0b545969cc523db0d2b4153, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:58.156456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:58.185040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 968/1961] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:58 2022] PUT /identity/v3/projects/932233345a3d4c898c381c892d64a02d/users/54349308c0b545969cc523db0d2b4153/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:58.189380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.203659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d36a1-8833-46ef-9d8e-52b34cad2c74 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:58.335586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:58.385292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:58.387022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.387297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.387725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.388506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:58.393537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:58.411088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 994/1962] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:12:58.415131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.430034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb1fa5-afbb-4a87-b8f7-56824b9c3771 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:58.442058 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.444024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:58.451274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd54d4-a49a-4901-9c21-4e70d8f6e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:58.452016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd54d4-a49a-4901-9c21-4e70d8f6e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.452300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd54d4-a49a-4901-9c21-4e70d8f6e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.452582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd54d4-a49a-4901-9c21-4e70d8f6e2be admin admin] PATH_INFO: `/v3/projects/932233345a3d4c898c381c892d64a02d/users/54349308c0b545969cc523db0d2b4153/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.461404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd54d4-a49a-4901-9c21-4e70d8f6e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=932233345a3d4c898c381c892d64a02d, user_id=54349308c0b545969cc523db0d2b4153, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:58.464070 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a0828-8784-40a1-b5cb-53d1e4672442 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:58.464202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd54d4-a49a-4901-9c21-4e70d8f6e2be admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:58.481545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:58.482779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.482779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.483022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] PATH_INFO: `/v3/users/ce979f1c7fdc469996993f1044a15276` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.484288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce979f1c7fdc469996993f1044a15276)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:58.486795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:58.492864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 969/1963] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:12:58 2022] PUT /identity/v3/projects/932233345a3d4c898c381c892d64a02d/users/54349308c0b545969cc523db0d2b4153/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:58.494381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.494668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.494956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.563188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce979f1c7fdc469996993f1044a15276'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:58.572859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce979f1c7fdc469996993f1044a15276'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:58.573860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce979f1c7fdc469996993f1044a15276'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:58.575528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce979f1c7fdc469996993f1044a15276'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:58.585512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a772ba4f-fc39-4c5a-a175-ef44d4743347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce979f1c7fdc469996993f1044a15276'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:58.587581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] MFA Rules not processed for user `54349308c0b545969cc523db0d2b4153`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:58.589141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:58.611740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 995/1964] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:58 2022] DELETE /identity/v3/users/ce979f1c7fdc469996993f1044a15276 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:12:58.626034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:58.626339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:58.626622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:58.684783 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:58.686207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:58.816592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 970/1965] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:58.824864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.827821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:58.862897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 996/1966] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:58.895056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:58.896721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:58.938757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:59.016047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b38e93-9cb6-4e81-a06f-27faa321ee8b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:59.022049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:12:59.036597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e72447-f736-42c9-87f6-5695d84ff482 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:59.042719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:59.043358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:59.043639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:59.043986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:59.064530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:59.073152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:59.095418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 997/1967] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:59.181680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c3c-584c-4f0f-ab01-e5324f0f3568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:59.184929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c3c-584c-4f0f-ab01-e5324f0f3568 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:59.186246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c3c-584c-4f0f-ab01-e5324f0f3568 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:59.186858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c3c-584c-4f0f-ab01-e5324f0f3568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:59.382720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148c3c-584c-4f0f-ab01-e5324f0f3568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:59.392129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148c3c-584c-4f0f-ab01-e5324f0f3568 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:59.427439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 971/1968] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:12:59.494297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:59.495854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:59.534253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47e670-bb03-4b29-856e-851f61257ad7 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:12:59.552001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:12:59.552929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:59.553214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:59.553491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] PATH_INFO: `/v3/users/a9dba1076d96435b9f452a7c2b93206b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:59.555133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9dba1076d96435b9f452a7c2b93206b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:12:59.557118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:12:59.683130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9dba1076d96435b9f452a7c2b93206b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:59.704381 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9dba1076d96435b9f452a7c2b93206b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:59.705646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9dba1076d96435b9f452a7c2b93206b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:59.710113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9dba1076d96435b9f452a7c2b93206b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:59.720462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9dba1076d96435b9f452a7c2b93206b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:12:59.762960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 998/1969] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:12:59 2022] DELETE /identity/v3/users/a9dba1076d96435b9f452a7c2b93206b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:12:59.767183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:12:59.767653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:12:59.768141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:12:59.807675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:12:59.809132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:12:59.940357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 972/1970] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:12:59.950040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:12:59.951807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:00.105990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522a2d6-dea6-4ce2-9819-de039f6db4ef admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:00.111397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:00.112258 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:00.112871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:00.113283 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:00.131316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:00.134317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:00.160120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 999/1971] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:00.554014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:00.556023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:00.583382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8e5f4-5e7b-4951-ba8e-58b5a2951043 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:00.592516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:00.593173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:00.593452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:00.593906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] PATH_INFO: `/v3/projects/bd2e359440b648dcabd5aad258400446` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:00.595383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2e359440b648dcabd5aad258400446)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:00.598848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:00.664310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:00.700836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2e359440b648dcabd5aad258400446', 'request_id': 'req-09982da6-fe46-42e0-9222-d52d49d439e3'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:00.712353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:00.714537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:00.729162 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2e359440b648dcabd5aad258400446', 'request_id': 'req-09982da6-fe46-42e0-9222-d52d49d439e3'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:00.741898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2e359440b648dcabd5aad258400446', 'request_id': 'req-09982da6-fe46-42e0-9222-d52d49d439e3'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:00.752006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3aaa-fbb3-43fb-af17-62eae4d95534 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:00.774242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] The token cache is being invalidate because project bd2e359440b648dcabd5aad258400446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:00.774546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:00.778824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:00.793884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 973/1972] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:00 2022] DELETE /identity/v3/projects/bd2e359440b648dcabd5aad258400446 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:00.892007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:00.893521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.064313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:01.064967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.066071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.066503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] PATH_INFO: `/v3/users/ec426b28a2df463abf0fa4afa77dce89` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.068115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec426b28a2df463abf0fa4afa77dce89)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:01.070261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:01.077553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:01.119478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09982da6-fe46-42e0-9222-d52d49d439e3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:01.132684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:01.133350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.133628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.134253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] PATH_INFO: `/v3/projects/326c543d6e3c417eaf39593b0a691fd4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.138034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=326c543d6e3c417eaf39593b0a691fd4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:01.140834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:01.169319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec426b28a2df463abf0fa4afa77dce89'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.220554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec426b28a2df463abf0fa4afa77dce89'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.224964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec426b28a2df463abf0fa4afa77dce89'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.228334 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec426b28a2df463abf0fa4afa77dce89'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.254130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-545547d6-5df9-4107-a461-74d6503d453b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec426b28a2df463abf0fa4afa77dce89'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.273532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1000/1973] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:00 2022] DELETE /identity/v3/users/ec426b28a2df463abf0fa4afa77dce89 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:01.275704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326c543d6e3c417eaf39593b0a691fd4', 'request_id': 'req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.277956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.278320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.278647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.290165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326c543d6e3c417eaf39593b0a691fd4', 'request_id': 'req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.302515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:01.304068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.304257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326c543d6e3c417eaf39593b0a691fd4', 'request_id': 'req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.321218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] The token cache is being invalidate because project 326c543d6e3c417eaf39593b0a691fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:01.322243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.323104 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.324828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 974/1974] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:00 2022] DELETE /identity/v3/projects/326c543d6e3c417eaf39593b0a691fd4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:01.329893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:01.332756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.410005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1001/1975] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:01.411528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:01.413239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.429739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fa9fd-aa16-4c01-86df-a43f9b4da693 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:01.435076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:01.436284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.436567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.436846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] PATH_INFO: `/v3/users/15e9c483c274477d841b0372861925c8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.438926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e9c483c274477d841b0372861925c8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:01.441852 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:01.453852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:01.473016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacb8d3-5bea-493b-941c-1fcd9d9e8d2b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:01.485964 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:01.486925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.487255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.488218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] PATH_INFO: `/v3/users/54349308c0b545969cc523db0d2b4153` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.489574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54349308c0b545969cc523db0d2b4153)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:01.492057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:01.517164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e9c483c274477d841b0372861925c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.528196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e9c483c274477d841b0372861925c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.528930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e9c483c274477d841b0372861925c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.530170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e9c483c274477d841b0372861925c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.540920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e9c483c274477d841b0372861925c8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.557957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:01.562855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54349308c0b545969cc523db0d2b4153'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.569021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1002/1976] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:01 2022] DELETE /identity/v3/users/15e9c483c274477d841b0372861925c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:01.570880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:01.572182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54349308c0b545969cc523db0d2b4153'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.572783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54349308c0b545969cc523db0d2b4153'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.573407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54349308c0b545969cc523db0d2b4153'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.577622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.581961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7d6c002a-e83d-43da-b026-5f9fda19d204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54349308c0b545969cc523db0d2b4153'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:01.604389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 975/1977] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:01 2022] DELETE /identity/v3/users/54349308c0b545969cc523db0d2b4153 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:01.605466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.605753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.606034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.639111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:01.640373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.678285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a8e27-fd59-4ba4-b531-c83231cb0b3b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:01.747354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 976/1978] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:01.770213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:01.770828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.772589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.772751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.775899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.806403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:01.818385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:01.819969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:01.820275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:01.842228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f0cd1-3f9b-4a44-9967-a8f9d125b6ee None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:01.842571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1003/1979] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:01.859034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d27915-d8f9-4156-bf9f-0fb41af85b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:01.859696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27915-d8f9-4156-bf9f-0fb41af85b54 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:01.860010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27915-d8f9-4156-bf9f-0fb41af85b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:01.864237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d27915-d8f9-4156-bf9f-0fb41af85b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:01.890788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d27915-d8f9-4156-bf9f-0fb41af85b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:01.890788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d27915-d8f9-4156-bf9f-0fb41af85b54 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:01.910043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 977/1980] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:02.676410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:02.677874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:02.698472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d2c6a-607b-4043-a2cf-a767af5e39a7 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:02.706358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:02.707320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:02.708439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:02.708935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] PATH_INFO: `/v3/projects/932233345a3d4c898c381c892d64a02d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:02.711345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=932233345a3d4c898c381c892d64a02d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:02.714174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:02.826719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932233345a3d4c898c381c892d64a02d', 'request_id': 'req-098b2e6a-c7de-4146-9354-209f3326eb3a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:02.837615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932233345a3d4c898c381c892d64a02d', 'request_id': 'req-098b2e6a-c7de-4146-9354-209f3326eb3a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:02.845750 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932233345a3d4c898c381c892d64a02d', 'request_id': 'req-098b2e6a-c7de-4146-9354-209f3326eb3a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:02.860875 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] The token cache is being invalidate because project 932233345a3d4c898c381c892d64a02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:02.861703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:02.862403 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:02.864393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1004/1981] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:02 2022] DELETE /identity/v3/projects/932233345a3d4c898c381c892d64a02d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:02.870535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b858404-52bd-433a-9523-29e520163f00 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:02.871039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b858404-52bd-433a-9523-29e520163f00 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:02.871118 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b858404-52bd-433a-9523-29e520163f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:02.901428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4b858404-52bd-433a-9523-29e520163f00 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:02.902796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4b858404-52bd-433a-9523-29e520163f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:02.956252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:02.971323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.016205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:03.040989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 978/1982] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:03.042395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b858404-52bd-433a-9523-29e520163f00 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.047809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4b858404-52bd-433a-9523-29e520163f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.049190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:03.061794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b858404-52bd-433a-9523-29e520163f00 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.066623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.067328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.067640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.067931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] PATH_INFO: `/v3/projects/66d04e10517a4ab4a480963d6f7a3ae2` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.069074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d04e10517a4ab4a480963d6f7a3ae2)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.070965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.080322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b2e6a-c7de-4146-9354-209f3326eb3a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.085797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.086548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.086929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.087391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] PATH_INFO: `/v3/projects/1bf00c2c27c74e2cb034b41efda51fc5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.088695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf00c2c27c74e2cb034b41efda51fc5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.091479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.129400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d04e10517a4ab4a480963d6f7a3ae2', 'request_id': 'req-859bae68-f9ce-409f-b5c0-343c84541989'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.140257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d04e10517a4ab4a480963d6f7a3ae2', 'request_id': 'req-859bae68-f9ce-409f-b5c0-343c84541989'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.147278 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d04e10517a4ab4a480963d6f7a3ae2', 'request_id': 'req-859bae68-f9ce-409f-b5c0-343c84541989'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.151781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf00c2c27c74e2cb034b41efda51fc5', 'request_id': 'req-da090bba-1973-46e5-83d0-23bcb9ed74c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.160319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf00c2c27c74e2cb034b41efda51fc5', 'request_id': 'req-da090bba-1973-46e5-83d0-23bcb9ed74c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.160889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] The token cache is being invalidate because project 66d04e10517a4ab4a480963d6f7a3ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:03.161185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.162123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-859bae68-f9ce-409f-b5c0-343c84541989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.165328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 979/1983] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:03 2022] DELETE /identity/v3/projects/66d04e10517a4ab4a480963d6f7a3ae2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:03.166558 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.166919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.167218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.169275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf00c2c27c74e2cb034b41efda51fc5', 'request_id': 'req-da090bba-1973-46e5-83d0-23bcb9ed74c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.182290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] The token cache is being invalidate because project 1bf00c2c27c74e2cb034b41efda51fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:03.182581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.183340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.184870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1005/1984] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:02 2022] DELETE /identity/v3/projects/1bf00c2c27c74e2cb034b41efda51fc5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:03.186358 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.187636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.191157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:03.192383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.251982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 980/1985] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:03.252833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.253119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090bba-1973-46e5-83d0-23bcb9ed74c1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.254185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.258204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.258909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.259116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.259390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] PATH_INFO: `/v3/users/c671e58ee5384bfe9cb5cd6519cb6782` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.260545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c671e58ee5384bfe9cb5cd6519cb6782)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.262473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.266033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe47f3-ebe8-476b-8afe-80c1f2cf8322 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.270875 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.271952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.272315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.272698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] PATH_INFO: `/v3/users/bdb56e417b8c4df49adc8822bfef549d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.273969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb56e417b8c4df49adc8822bfef549d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.275934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.322212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c671e58ee5384bfe9cb5cd6519cb6782'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.331371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb56e417b8c4df49adc8822bfef549d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.331834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c671e58ee5384bfe9cb5cd6519cb6782'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.332578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c671e58ee5384bfe9cb5cd6519cb6782'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.333456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c671e58ee5384bfe9cb5cd6519cb6782'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.340083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb56e417b8c4df49adc8822bfef549d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.340852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb56e417b8c4df49adc8822bfef549d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.341511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb56e417b8c4df49adc8822bfef549d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.342602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c671e58ee5384bfe9cb5cd6519cb6782'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.356442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb56e417b8c4df49adc8822bfef549d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:03.369631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:03.376642 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:03.391103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 981/1986] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:03 2022] DELETE /identity/v3/users/bdb56e417b8c4df49adc8822bfef549d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:03.394396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.394396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.404671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1006/1987] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:03 2022] DELETE /identity/v3/users/c671e58ee5384bfe9cb5cd6519cb6782 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:03.488059 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de286-7ff9-4796-8f0e-b18c7a23909b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.577295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.577993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.578339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.578678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.579395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:03.579781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.581511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.599860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 982/1988] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:03.601064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.602567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:03.617220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dc0f6-ddc3-4bbc-a406-b5dad914e25f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.621831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.622477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.622769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.623038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.623778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.625599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.660272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1007/1989] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:03 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:03.661536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.672941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e2928-c04c-4178-b08a-e5e3411c61e0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.762860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.764480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.764859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.765249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.766139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.769690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.802396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 983/1990] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:03 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:03.803748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.817083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13031c30-9604-43a7-ab89-636279892108 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.822504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.823186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.823534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.823900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.824619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.826340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.839914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1008/1991] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:03.842491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.856463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83233550-c642-4061-b57f-4c7d8777b303 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.863233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952024-98b9-4d20-ad5a-d2b2669e9025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.863233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952024-98b9-4d20-ad5a-d2b2669e9025 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.863534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952024-98b9-4d20-ad5a-d2b2669e9025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.863958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952024-98b9-4d20-ad5a-d2b2669e9025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.864666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952024-98b9-4d20-ad5a-d2b2669e9025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.866409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952024-98b9-4d20-ad5a-d2b2669e9025 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.880916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 984/1992] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:03.885085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:03.896549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b194d0-7cdd-4c77-a681-58fd5533129c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:03.903116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:03.904073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.904501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.904953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] PATH_INFO: `/v3/projects/351021ca142b4352a5943d5c05150cec/users/4446410b297141419e9f101fc75328d7/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:03.922045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=351021ca142b4352a5943d5c05150cec, user_id=4446410b297141419e9f101fc75328d7, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:03.925370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:03.942786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1009/1993] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:03 2022] PUT /identity/v3/projects/351021ca142b4352a5943d5c05150cec/users/4446410b297141419e9f101fc75328d7/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:03.954643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:03.955436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:03.955941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.014666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:04.018256 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] MFA Rules not processed for user `4446410b297141419e9f101fc75328d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:04.020358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.081077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.083113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.141834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 985/1994] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:04.145523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.145523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.166113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4615da6-92c4-42d8-9f97-29204dcdec7c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.181499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.182435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.182760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.183034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] PATH_INFO: `/v3/projects/f85ce26399e243278168052ee6442ae6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.184523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85ce26399e243278168052ee6442ae6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.187562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.260080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439bc6c-0c8f-4aca-9f0e-4b14ff0bf59e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.262207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85ce26399e243278168052ee6442ae6', 'request_id': 'req-3e3e914a-137f-4105-89fc-ade3eaf958be'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.276665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85ce26399e243278168052ee6442ae6', 'request_id': 'req-3e3e914a-137f-4105-89fc-ade3eaf958be'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.289164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85ce26399e243278168052ee6442ae6', 'request_id': 'req-3e3e914a-137f-4105-89fc-ade3eaf958be'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.310250 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] The token cache is being invalidate because project f85ce26399e243278168052ee6442ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:04.310456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.312864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.314016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1010/1995] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:04 2022] DELETE /identity/v3/projects/f85ce26399e243278168052ee6442ae6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:04.319441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.322935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.365439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.366158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.366277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.366557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] PATH_INFO: `/v3/projects/248ba3bcb26e49909f9a45f10112d4f4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.370680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=248ba3bcb26e49909f9a45f10112d4f4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.374744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.375195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:04.477779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e914a-137f-4105-89fc-ade3eaf958be admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.527847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248ba3bcb26e49909f9a45f10112d4f4', 'request_id': 'req-c4682233-367e-4155-81ea-af1aa74cd35e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.537482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:04.561400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248ba3bcb26e49909f9a45f10112d4f4', 'request_id': 'req-c4682233-367e-4155-81ea-af1aa74cd35e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.570955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248ba3bcb26e49909f9a45f10112d4f4', 'request_id': 'req-c4682233-367e-4155-81ea-af1aa74cd35e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.585442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] The token cache is being invalidate because project 248ba3bcb26e49909f9a45f10112d4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:04.585994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.586880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4682233-367e-4155-81ea-af1aa74cd35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:04.589598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 986/1996] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:04 2022] DELETE /identity/v3/projects/248ba3bcb26e49909f9a45f10112d4f4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:04.591049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b44d3-3dd0-419b-8945-9100fa768e70 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.591569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b44d3-3dd0-419b-8945-9100fa768e70 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.592378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b44d3-3dd0-419b-8945-9100fa768e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.616654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-af9b44d3-3dd0-419b-8945-9100fa768e70 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:04.618548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-af9b44d3-3dd0-419b-8945-9100fa768e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.622025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a992ed-055d-4c4c-aeb2-69be18d3a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.622696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a992ed-055d-4c4c-aeb2-69be18d3a871 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.622982 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a992ed-055d-4c4c-aeb2-69be18d3a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.623251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a992ed-055d-4c4c-aeb2-69be18d3a871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.623893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a992ed-055d-4c4c-aeb2-69be18d3a871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.625812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a992ed-055d-4c4c-aeb2-69be18d3a871 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.628721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 987/1997] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:04.630153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23483d4a-b7d9-4725-8856-8f6d76adc6f4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.630439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23483d4a-b7d9-4725-8856-8f6d76adc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.630739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23483d4a-b7d9-4725-8856-8f6d76adc6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.653349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-23483d4a-b7d9-4725-8856-8f6d76adc6f4 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:04.654815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-23483d4a-b7d9-4725-8856-8f6d76adc6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.663054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 988/1998] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:04.670944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.670944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.670944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.674734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1011/1999] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/projects => generated 383 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:04.676120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48790b7-3824-4ead-b45c-474630974399 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.676411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48790b7-3824-4ead-b45c-474630974399 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.676688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48790b7-3824-4ead-b45c-474630974399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.690040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:04.691832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.703054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a48790b7-3824-4ead-b45c-474630974399 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:04.704482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a48790b7-3824-4ead-b45c-474630974399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.783720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1012/2000] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:04.783720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48790b7-3824-4ead-b45c-474630974399 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.783720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a48790b7-3824-4ead-b45c-474630974399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:04.801099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48790b7-3824-4ead-b45c-474630974399 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.801931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 989/2001] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:04.803335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.807120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.807896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.808274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.808639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.809368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.813165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.823012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a25645-ae12-4d8e-8c6d-ce58afebe9e6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.830783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.831518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.831800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.832167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.832988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:04.833294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.835088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.840576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1013/2002] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/users => generated 298 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:04.841529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.856072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155bf7-7006-4529-b418-964a9b565429 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.865466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.866084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.866360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.866768 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.867425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:04.867794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.868926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 990/2003] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:04.869797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.874876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.889527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1014/2004] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:04.896912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.900591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c35dc-08b1-432d-a287-52e233aa6b65 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.906689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.907304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.907637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.907949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.910415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a202771-ab78-4430-8c8b-61bcc5e345d7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.912411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.914322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.915451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.916554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.917325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.917608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.918835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.921500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.927009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 991/2005] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:04.931251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.944703 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fdb29-d722-4dbf-8e2c-939a757185ee admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:04.953444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:04.954153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:04.954645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:04.954904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:04.956395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:04.959423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:04.960168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:04.971977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1015/2006] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:04.972807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:04.991099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 992/2007] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:04.991959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.091208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f3440-4642-4c14-9023-77be8e3acc76 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.114426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900f894-3d61-438f-8d14-41a66df682fd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.122248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.123945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.124299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.125477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.125871 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.128744 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.169133 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 993/2008] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:04 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:05.169133 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.177980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d836-e7d7-4d39-9f44-b64a96f6183f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.182849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.183589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.183776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.184164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.184499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.184611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.184889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.185696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] PATH_INFO: `/v3/projects/c9265cf053d04eda8d792acf9d709f7f/users/1243d1f6628b4dd3851a5c3eead2d4cc/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.185857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.187891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.199764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:05.204975 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9265cf053d04eda8d792acf9d709f7f, user_id=1243d1f6628b4dd3851a5c3eead2d4cc, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.208141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.218901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 994/2009] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:05.220154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.229679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1016/2010] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:04 2022] PUT /identity/v3/projects/c9265cf053d04eda8d792acf9d709f7f/users/1243d1f6628b4dd3851a5c3eead2d4cc/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:05.230738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.248330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d422b3a-7ea7-4db2-87e5-099ab1870c6e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.302505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b07034-f838-4bbb-9396-ae85e39627dd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.307981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.308869 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.309340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.309685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.310447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.312084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.318927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.319687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.320145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.320420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.321064 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.326706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.326845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1017/2011] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:05.326845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.335506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612f27-b93c-4072-a5c6-98d3336b590c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.339345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 995/2012] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:05.339345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.340887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.342153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.342438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.342712 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.343352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.344989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.350724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d6d28-c4b1-44a5-87ed-8ebdda282de3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.355841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.356204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.356705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.356811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1018/2013] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:05.357460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.360155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.360842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.363528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.368374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7d0c-f761-4169-845d-cbdce628a71a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.373428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.374101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.374450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.374789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.375492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.376510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 996/2014] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:05.377820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.380379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.392652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1019/2015] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:05.392652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.392921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a81b8-3320-402f-8921-696cff2e497e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.397243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.397449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:05.397911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.398195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.398474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] PATH_INFO: `/v3/projects/c9265cf053d04eda8d792acf9d709f7f/users/1243d1f6628b4dd3851a5c3eead2d4cc/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.400740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9265cf053d04eda8d792acf9d709f7f, user_id=1243d1f6628b4dd3851a5c3eead2d4cc, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.402678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56d5832-bdd5-4211-b739-7554df99e154 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.403387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.410627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a9a78-9e6b-4dc7-bde1-66b2c15288a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.411529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9a78-9e6b-4dc7-bde1-66b2c15288a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.411996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9a78-9e6b-4dc7-bde1-66b2c15288a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.412454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a9a78-9e6b-4dc7-bde1-66b2c15288a1 admin admin] PATH_INFO: `/v3/projects/4b0351ff514e4ff8a616afdecbb1b7c6/users/ec02c554ca304fc6a322cc0adf89a9a2/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.415699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 997/2016] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:05 2022] PUT /identity/v3/projects/c9265cf053d04eda8d792acf9d709f7f/users/1243d1f6628b4dd3851a5c3eead2d4cc/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:05.426855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.430484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9a78-9e6b-4dc7-bde1-66b2c15288a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0351ff514e4ff8a616afdecbb1b7c6, user_id=ec02c554ca304fc6a322cc0adf89a9a2, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.433610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a9a78-9e6b-4dc7-bde1-66b2c15288a1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.452088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1020/2017] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:05 2022] PUT /identity/v3/projects/4b0351ff514e4ff8a616afdecbb1b7c6/users/ec02c554ca304fc6a322cc0adf89a9a2/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:05.453344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984357a3-c77a-44da-9d19-f077c10f53ca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.453559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984357a3-c77a-44da-9d19-f077c10f53ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.453763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984357a3-c77a-44da-9d19-f077c10f53ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.486783 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-984357a3-c77a-44da-9d19-f077c10f53ca None None] MFA Rules not processed for user `1243d1f6628b4dd3851a5c3eead2d4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:05.488284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-984357a3-c77a-44da-9d19-f077c10f53ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:05.504699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c010f92-da6c-40a8-a4aa-5b4b768a3746 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.562675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1021/2018] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:05.568041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e876-5462-4a8d-bb4e-e88ec8863af1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.568337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e876-5462-4a8d-bb4e-e88ec8863af1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.568867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3e876-5462-4a8d-bb4e-e88ec8863af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.570030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.570879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.571308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.571720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] PATH_INFO: `/v3/projects/6ada63d1327c4e4296ce4502f9e2e6e0/users/1eb2532de94c42ef934658e71562752b/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.595349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ada63d1327c4e4296ce4502f9e2e6e0, user_id=1eb2532de94c42ef934658e71562752b, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.601390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.605228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:05.605539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-85a3e876-5462-4a8d-bb4e-e88ec8863af1 None None] MFA Rules not processed for user `ec02c554ca304fc6a322cc0adf89a9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:05.606922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85a3e876-5462-4a8d-bb4e-e88ec8863af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:05.619247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 998/2019] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:05 2022] PUT /identity/v3/projects/6ada63d1327c4e4296ce4502f9e2e6e0/users/1eb2532de94c42ef934658e71562752b/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:05.620002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.621551 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:05.677829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1022/2020] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:05.681563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.681563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.681563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.690207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9c4a-56ac-4d36-9b7a-d827bfbe1ebd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.702969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.704571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.704860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.705142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.712866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] MFA Rules not processed for user `1eb2532de94c42ef934658e71562752b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:05.714455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:05.769076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:05.777780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.779343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.790821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 999/2021] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:05.791615 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.796191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1023/2022] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:05.801466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:05.900332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345db128-3d65-4aac-bc67-f6019f5b6104 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.907843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.908786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.909075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.909351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.909993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.912287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.929001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ceb10-1258-4f93-b936-3121b0f3fb6b service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:05.953645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:05.954387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:05.954675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:05.954946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:05.955594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:05.957891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:05.961244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1024/2023] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:05.962917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.027765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1000/2024] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:06.028707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.120278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598077c4-658f-4e43-99bd-b877069e5e30 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.136274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:06.182076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51f238-c519-4233-9ded-b42704e5c106 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.186072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.186692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.187025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.187302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.189184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:06.219389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.220050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.220330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.220600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.221226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.223153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.271785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1025/2025] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:05 2022] POST /identity/v3/users => generated 299 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:06.273411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.273936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.275536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.287140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1001/2026] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:06.288176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.296380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb56182c-b92d-479e-8b3e-f08302a64a49 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.302044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a858b-e7fb-43b4-8b4e-d2b4c4e343e6 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.306955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.307574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.307887 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.308160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.308797 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.310777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.317004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.318142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.318632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.319250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.319383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:06.320163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.322826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.340738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1002/2027] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:06.340877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1026/2028] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:06 2022] POST /identity/v3/users => generated 292 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:06.345582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.345730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.357810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7a31e-4bc6-4ce8-a6ff-220516305d44 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.360654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74923f11-d262-4f5b-82b9-db69f63d6df1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.368853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.369781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.370439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.370972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.372945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.374671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.379685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.381324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.381704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.381877 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] PATH_INFO: `/v3/projects/a4fb524857794d6cbf0f2cb2906fb7cd/users/ff6bb54b43054f7ea40fc4f34fb5e2e7/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.391973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1027/2029] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:06.396440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.423678 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdba623-5310-4992-aad2-1b94fd24465e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.426408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fb524857794d6cbf0f2cb2906fb7cd, user_id=ff6bb54b43054f7ea40fc4f34fb5e2e7, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.429555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.429684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.430361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.430746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.431290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.432077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.434039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.454760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1028/2030] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:06.454985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1003/2031] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:06 2022] PUT /identity/v3/projects/a4fb524857794d6cbf0f2cb2906fb7cd/users/ff6bb54b43054f7ea40fc4f34fb5e2e7/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:06.459274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.459443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.470072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef853c-a9a1-44c3-ae6a-149b523f55ba admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.587697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50399b-59e7-4fd5-a66c-0e065a5a4927 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.599767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.601612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.601958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.603571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.604412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.606673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.612946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee6fc5-4cff-4952-932e-a6afa81ba27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.613928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee6fc5-4cff-4952-932e-a6afa81ba27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.614533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee6fc5-4cff-4952-932e-a6afa81ba27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.615017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee6fc5-4cff-4952-932e-a6afa81ba27d admin admin] PATH_INFO: `/v3/projects/0423b572853245fdbbaf4e9e57f2b639/users/b41bcd373e09434b9170f4d8e809debc/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.625631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1004/2032] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:06.630851 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.643610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004aa7-d35a-4520-9149-b6e96e93b97c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.649761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b726b-e6ed-47e6-adc6-afce74f67c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.650450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b726b-e6ed-47e6-adc6-afce74f67c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.650709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b726b-e6ed-47e6-adc6-afce74f67c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.651183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b726b-e6ed-47e6-adc6-afce74f67c90 admin admin] PATH_INFO: `/v3/projects/a4fb524857794d6cbf0f2cb2906fb7cd/users/ff6bb54b43054f7ea40fc4f34fb5e2e7/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.653396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b726b-e6ed-47e6-adc6-afce74f67c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fb524857794d6cbf0f2cb2906fb7cd, user_id=ff6bb54b43054f7ea40fc4f34fb5e2e7, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.657032 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b726b-e6ed-47e6-adc6-afce74f67c90 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.672687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee6fc5-4cff-4952-932e-a6afa81ba27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0423b572853245fdbbaf4e9e57f2b639, user_id=b41bcd373e09434b9170f4d8e809debc, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.678091 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee6fc5-4cff-4952-932e-a6afa81ba27d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.686590 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1005/2033] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:06 2022] PUT /identity/v3/projects/a4fb524857794d6cbf0f2cb2906fb7cd/users/ff6bb54b43054f7ea40fc4f34fb5e2e7/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:06.696900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.697287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.697673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.710114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1029/2034] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:06 2022] PUT /identity/v3/projects/0423b572853245fdbbaf4e9e57f2b639/users/b41bcd373e09434b9170f4d8e809debc/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:06.721384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.721851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.722366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.766066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] MFA Rules not processed for user `ff6bb54b43054f7ea40fc4f34fb5e2e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:06.769117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:06.774762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] MFA Rules not processed for user `b41bcd373e09434b9170f4d8e809debc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:06.777102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:06.800743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:06.869430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1030/2035] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:06.870484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.886809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1006/2036] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:06.898598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:06.900483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:06.928679 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:06.960521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760bfa7-fb1c-4fc8-8c08-30ce297bce12 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.968196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.968824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.969162 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.969447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.970272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.973537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:06.976568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea6ae7-eb4c-4eac-bc5f-aa15a1224e05 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:06.982916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:06.983639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:06.984093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:06.984550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:06.995912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:06.997337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.008308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1031/2037] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:06 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:07.012042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.012778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1007/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:07.095353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde416fe-43d0-4bf0-9408-7cd1c9d35c20 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.099167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.103537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.104440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.104818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.105232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.105957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.108700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.125280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fead615-2342-4e59-8bc0-00167229078b service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.136464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1032/2039] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:07 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:07.138604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.139363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.139650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.139984 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] PATH_INFO: `/v3/users/1eb2532de94c42ef934658e71562752b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.141039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.141462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb2532de94c42ef934658e71562752b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.145797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.164489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55447677-b11b-4be4-b7c5-8a5e9b0c1820 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.174141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.174970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.175421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.175835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.176743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.178949 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.198769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1033/2040] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:07.204135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.221939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829cdb8-167c-4438-acd7-296c6c68704a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.227756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.228452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.228785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.229019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] PATH_INFO: `/v3/projects/8a62914396964e8db647ae27eae44c4b/users/eb7c428ae6d34c54b4f3c9af8ee56784/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.231949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb2532de94c42ef934658e71562752b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:07.243941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb2532de94c42ef934658e71562752b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:07.245588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb2532de94c42ef934658e71562752b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:07.246788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb2532de94c42ef934658e71562752b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:07.261589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-87bffa00-267b-4c92-997d-135ccd10e5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb2532de94c42ef934658e71562752b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:07.267936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a62914396964e8db647ae27eae44c4b, user_id=eb7c428ae6d34c54b4f3c9af8ee56784, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.270967 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.289990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1008/2041] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:07 2022] DELETE /identity/v3/users/1eb2532de94c42ef934658e71562752b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:07.297497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.298723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.299609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.304783 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1034/2042] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:07 2022] PUT /identity/v3/projects/8a62914396964e8db647ae27eae44c4b/users/eb7c428ae6d34c54b4f3c9af8ee56784/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:07.309074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.314590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:07.350115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:07.352999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:07.396138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:07.442499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3451ed-90a1-4905-ac02-5ff1906e99e0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.448373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.449297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.449579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.449856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.450573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.453195 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.471909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1035/2043] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:07.473064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.475765 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1009/2044] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:07.485884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe99d65-53b1-4377-a3bf-2a0976b5e413 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.487781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.489501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:07.492315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20316312-7f2c-4491-91b8-9c827305d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.493736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20316312-7f2c-4491-91b8-9c827305d29a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.494232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20316312-7f2c-4491-91b8-9c827305d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.494876 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20316312-7f2c-4491-91b8-9c827305d29a admin admin] PATH_INFO: `/v3/projects/8a62914396964e8db647ae27eae44c4b/users/eb7c428ae6d34c54b4f3c9af8ee56784/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.499337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20316312-7f2c-4491-91b8-9c827305d29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a62914396964e8db647ae27eae44c4b, user_id=eb7c428ae6d34c54b4f3c9af8ee56784, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.504661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20316312-7f2c-4491-91b8-9c827305d29a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.527934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1036/2045] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:07 2022] PUT /identity/v3/projects/8a62914396964e8db647ae27eae44c4b/users/eb7c428ae6d34c54b4f3c9af8ee56784/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:07.539425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.539660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.539834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.553221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:07.582910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] MFA Rules not processed for user `eb7c428ae6d34c54b4f3c9af8ee56784`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:07.584311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:07.594053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6ccdb-d606-496f-814c-986239b98605 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.680990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1037/2046] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:07.702351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:07.703581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.704485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.705041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.705410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:07.705596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.818645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f4b61-1274-4e92-be06-82230fbc9114 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:07.829622 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.833888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.837406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:07.839342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:07.840851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:07.841285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:07.846480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:07.851686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1010/2047] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:07.974486 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:07.976143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:07.991208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1038/2048] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:08.229423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:08.231226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:08.251905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279d35-a636-4325-89d9-f7f88cd56d42 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:08.263264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:08.264748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:08.265282 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:08.265817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] PATH_INFO: `/v3/projects/6ada63d1327c4e4296ce4502f9e2e6e0` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:08.267575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ada63d1327c4e4296ce4502f9e2e6e0)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:08.270570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:08.329149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:08.356684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ada63d1327c4e4296ce4502f9e2e6e0', 'request_id': 'req-b1c74576-68cb-4e65-8924-51b0500d0f89'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.376668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ada63d1327c4e4296ce4502f9e2e6e0', 'request_id': 'req-b1c74576-68cb-4e65-8924-51b0500d0f89'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.386681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ada63d1327c4e4296ce4502f9e2e6e0', 'request_id': 'req-b1c74576-68cb-4e65-8924-51b0500d0f89'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.411150 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] The token cache is being invalidate because project 6ada63d1327c4e4296ce4502f9e2e6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:08.411625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.412705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.414557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1011/2049] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:08 2022] DELETE /identity/v3/projects/6ada63d1327c4e4296ce4502f9e2e6e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:08.418299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:08.432594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf60a3-9959-4174-9647-9291cd571d44 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:08.493212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:08.511825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:08.512676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:08.512959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:08.513756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] PATH_INFO: `/v3/users/ff6bb54b43054f7ea40fc4f34fb5e2e7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:08.514897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6bb54b43054f7ea40fc4f34fb5e2e7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:08.516893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:08.571033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6bb54b43054f7ea40fc4f34fb5e2e7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.578561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6bb54b43054f7ea40fc4f34fb5e2e7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.579248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6bb54b43054f7ea40fc4f34fb5e2e7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.579857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6bb54b43054f7ea40fc4f34fb5e2e7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.588532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6bb54b43054f7ea40fc4f34fb5e2e7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:08.607182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1039/2050] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:08 2022] DELETE /identity/v3/users/ff6bb54b43054f7ea40fc4f34fb5e2e7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:09.209534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.210944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.224463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c74576-68cb-4e65-8924-51b0500d0f89 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.240725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.242326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.320298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.321146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.321498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.321870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] PATH_INFO: `/v3/users/4446410b297141419e9f101fc75328d7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.323062 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4446410b297141419e9f101fc75328d7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.325089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:09.331242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c735-ee8b-43b9-87cc-8788983074ec admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.337636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.338287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.339061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.339333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] PATH_INFO: `/v3/projects/a4fb524857794d6cbf0f2cb2906fb7cd` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.340515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fb524857794d6cbf0f2cb2906fb7cd)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.343121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:09.380958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4446410b297141419e9f101fc75328d7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.389135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4446410b297141419e9f101fc75328d7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.389945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4446410b297141419e9f101fc75328d7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.390699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4446410b297141419e9f101fc75328d7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.402783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-54e1a4fd-3be6-4f77-b3db-b2282070f7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4446410b297141419e9f101fc75328d7'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.414520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fb524857794d6cbf0f2cb2906fb7cd', 'request_id': 'req-231f178a-d79f-4b68-8bf2-21522c6024b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.425646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1012/2051] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:09 2022] DELETE /identity/v3/users/4446410b297141419e9f101fc75328d7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:09.434125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.434418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.434696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.435779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fb524857794d6cbf0f2cb2906fb7cd', 'request_id': 'req-231f178a-d79f-4b68-8bf2-21522c6024b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.444819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fb524857794d6cbf0f2cb2906fb7cd', 'request_id': 'req-231f178a-d79f-4b68-8bf2-21522c6024b0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.447221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:09.458357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] The token cache is being invalidate because project a4fb524857794d6cbf0f2cb2906fb7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:09.458663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.459957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-231f178a-d79f-4b68-8bf2-21522c6024b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:09.461925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:09.462051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1040/2052] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:09 2022] DELETE /identity/v3/projects/a4fb524857794d6cbf0f2cb2906fb7cd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:09.463251 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.467958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bdef5-8825-437e-a63d-00213857b03f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.468320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bdef5-8825-437e-a63d-00213857b03f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.468670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bdef5-8825-437e-a63d-00213857b03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.506534 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-370bdef5-8825-437e-a63d-00213857b03f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:09.508128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-370bdef5-8825-437e-a63d-00213857b03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.543925 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:09.573665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1013/2053] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:09.584705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.586371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.601200 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1041/2054] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:09.610134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.610419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.610717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.634659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:09.635927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.645279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1042/2055] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:09.650377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.657817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dfa1d-b97e-4b64-8a65-b6415288b010 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.660916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af525b74-0f6e-41da-9122-09498d3bbbdb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.665980 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.666376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.666653 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.666922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.667567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:09.667882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.669668 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:09.672859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.673751 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.674141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.674524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.687505 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1043/2056] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:09.691926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.694362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.695903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:09.707707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04886b1-59ad-4dc9-b2c5-32fc764805dd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.712669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.713340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.713695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.714045 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.714744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.716808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:09.717080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1014/2057] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:09.718272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.719638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.748333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1044/2058] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:09 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:09.753884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.786195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a7beff-2b98-4a95-bd42-d0ee16007413 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.855018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ab75f-bbd2-45db-ac25-50fa15ed1cb7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.880188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.881355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.881794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.882325 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.883188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.890919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:09.892095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.893170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.893691 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.894171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.897325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:09.941004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1045/2059] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:09 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:09.961994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:09.981473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8b2d5-8f02-49fd-a851-977849c187b6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:09.993171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:09.994689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:09.995384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:09.995898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:09.996961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:09.999189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.007743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:10.012635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.015027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.018379 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1046/2060] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:10.022132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.028312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1015/2061] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:10.047146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64740e5b-9774-4894-bee7-06b64e9baedb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.057973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c58aa-eb2a-470c-947b-47182694054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.061595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c58aa-eb2a-470c-947b-47182694054b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.061879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c58aa-eb2a-470c-947b-47182694054b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.062153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c58aa-eb2a-470c-947b-47182694054b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.065786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c58aa-eb2a-470c-947b-47182694054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.067582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c58aa-eb2a-470c-947b-47182694054b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.115037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1047/2062] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:10.118297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.132820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27183e36-5ab5-41f7-99c6-6da582b919cf service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.138559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.140790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.140790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.141429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] PATH_INFO: `/v3/projects/e6ae86df6cc040e0902b747c03304424/users/16253010435d40618ab64ba3501d0e3b/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.161868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ae86df6cc040e0902b747c03304424, user_id=16253010435d40618ab64ba3501d0e3b, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.166089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.201783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1016/2063] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:10 2022] PUT /identity/v3/projects/e6ae86df6cc040e0902b747c03304424/users/16253010435d40618ab64ba3501d0e3b/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:10.212821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.213564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.213564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.265836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] MFA Rules not processed for user `16253010435d40618ab64ba3501d0e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:10.269656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:10.292953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:10.358949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.360774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:10.472068 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1048/2064] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:10.473015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.501905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b2b37-897b-4a5d-af00-aa3929fb2150 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.507452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.509500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.510068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.510579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] PATH_INFO: `/v3/projects/351021ca142b4352a5943d5c05150cec` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.512460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351021ca142b4352a5943d5c05150cec)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.515076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.592212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab902c6-c084-45ab-9372-22987d7991e1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.594658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351021ca142b4352a5943d5c05150cec', 'request_id': 'req-515d0e73-7ef2-45ef-9eff-f2f43287b452'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.608834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351021ca142b4352a5943d5c05150cec', 'request_id': 'req-515d0e73-7ef2-45ef-9eff-f2f43287b452'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.617719 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351021ca142b4352a5943d5c05150cec', 'request_id': 'req-515d0e73-7ef2-45ef-9eff-f2f43287b452'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.631299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] The token cache is being invalidate because project 351021ca142b4352a5943d5c05150cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:10.631600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.632298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.634468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1017/2065] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:10 2022] DELETE /identity/v3/projects/351021ca142b4352a5943d5c05150cec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:10.638589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.640447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:10.664880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.665501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.665798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.666050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.666680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.669069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.706123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1049/2066] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:10 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:10.710212 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.712983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:10.723120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0e73-7ef2-45ef-9eff-f2f43287b452 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.733759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:10.768447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:10.793989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.795524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.795806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.796114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] PATH_INFO: `/v3/users/1243d1f6628b4dd3851a5c3eead2d4cc` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.797372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1243d1f6628b4dd3851a5c3eead2d4cc)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.799524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.819516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad203c-795f-4c14-8bcb-3d83214865b1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.828227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.829282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.829720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.830347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.831574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.834234 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.870050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1050/2067] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:10 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:10.880079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.893698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787604-0f70-445b-af6e-0f70f50df1ea admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:10.899845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:10.900519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:10.900806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:10.901086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:10.905112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:10.907310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:10.917356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1243d1f6628b4dd3851a5c3eead2d4cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.921118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1051/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:10.922541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:10.926443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:10.930389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1243d1f6628b4dd3851a5c3eead2d4cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.932266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1243d1f6628b4dd3851a5c3eead2d4cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.933035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1243d1f6628b4dd3851a5c3eead2d4cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.946458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1243d1f6628b4dd3851a5c3eead2d4cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:10.988078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1018/2069] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:10 2022] DELETE /identity/v3/users/1243d1f6628b4dd3851a5c3eead2d4cc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:10.992845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.013154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.067108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2679b8-fd4c-4f2f-b693-abb3a56520c6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.115952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c62d87-c709-4c1c-9696-e8c4b48d885b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.120952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.121573 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.121856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.122132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.123305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.124946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.125911 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.127125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.128326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.128715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.130879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.139400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1019/2070] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:11.143019 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.156216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f6cea-c490-471d-a786-c29f5c4d56ac admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.163179 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c51161-fbb4-4424-a42a-c5a64d82383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.163899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c51161-fbb4-4424-a42a-c5a64d82383b admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.164253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c51161-fbb4-4424-a42a-c5a64d82383b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.164650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c51161-fbb4-4424-a42a-c5a64d82383b admin admin] PATH_INFO: `/v3/projects/28cad7877af2437a8c61057ff42d684c/users/2b12e4567c8a41a290e1d4af5ad66f75/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.183741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c51161-fbb4-4424-a42a-c5a64d82383b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28cad7877af2437a8c61057ff42d684c, user_id=2b12e4567c8a41a290e1d4af5ad66f75, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.187752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c51161-fbb4-4424-a42a-c5a64d82383b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.199009 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:11.207919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1020/2071] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:11 2022] PUT /identity/v3/projects/28cad7877af2437a8c61057ff42d684c/users/2b12e4567c8a41a290e1d4af5ad66f75/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:11.218835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.219158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.219418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.221473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.224368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.235981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1052/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:11.251241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] MFA Rules not processed for user `2b12e4567c8a41a290e1d4af5ad66f75`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:11.252929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.367509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1021/2073] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:11.369428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.382692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59921b46-73ab-488b-9335-701b7ac3428a service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.410302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:11.468733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.469367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.469648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.469925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.470969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.473462 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.488634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.492175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.516313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1450b48-9c72-44eb-9f58-cfe7afe348c2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.518690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1053/2074] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:11 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:11.519963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.607226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.608257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.610400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.610887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] PATH_INFO: `/v3/projects/c9265cf053d04eda8d792acf9d709f7f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.611901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f93a8-dede-4198-b457-eb910126db68 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.613024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9265cf053d04eda8d792acf9d709f7f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.615471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.617727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c926b6-4d91-4a24-ac81-b6c39339e44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.618621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c926b6-4d91-4a24-ac81-b6c39339e44e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.618854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c926b6-4d91-4a24-ac81-b6c39339e44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.619128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c926b6-4d91-4a24-ac81-b6c39339e44e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.620264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c926b6-4d91-4a24-ac81-b6c39339e44e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.622300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c926b6-4d91-4a24-ac81-b6c39339e44e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.654170 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1054/2075] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:11 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:11.656024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597519-b648-44d8-993e-7e4deff8afd7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.656327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597519-b648-44d8-993e-7e4deff8afd7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.656689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597519-b648-44d8-993e-7e4deff8afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.678771 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f1597519-b648-44d8-993e-7e4deff8afd7 None None] MFA Rules not processed for user `8e8172d3194e474997f25c25892c31ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:11.680372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f1597519-b648-44d8-993e-7e4deff8afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.683302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9265cf053d04eda8d792acf9d709f7f', 'request_id': 'req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:11.692897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9265cf053d04eda8d792acf9d709f7f', 'request_id': 'req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:11.713263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9265cf053d04eda8d792acf9d709f7f', 'request_id': 'req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:11.726931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] The token cache is being invalidate because project c9265cf053d04eda8d792acf9d709f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:11.727316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:11.728037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:11.729593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1022/2076] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:11 2022] DELETE /identity/v3/projects/c9265cf053d04eda8d792acf9d709f7f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:11.730359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.731779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.757107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1055/2077] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:11.757107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3291e-5e2a-4798-8b52-e4e262d52980 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.757107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3291e-5e2a-4798-8b52-e4e262d52980 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.757107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3291e-5e2a-4798-8b52-e4e262d52980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.757521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:11.780135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ecf3291e-5e2a-4798-8b52-e4e262d52980 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:11.781337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ecf3291e-5e2a-4798-8b52-e4e262d52980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.815082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa15e45-7e5a-4996-b1ca-f7cc48896a04 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.821030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.821557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.821843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.822120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.822825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.824525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.827681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:11.839489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1023/2078] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:11.840555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.851903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d41c7-b801-418c-ba8c-9802c447b489 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.856528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.857845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.858185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.858692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] PATH_INFO: `/v3/projects/0a10b8090f2e41a6aabed8d02c3b2d61/users/a48a341212f94480af4e99a44d842a4f/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.858810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1056/2079] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:11.868377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.868581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.868854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.875480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a10b8090f2e41a6aabed8d02c3b2d61, user_id=a48a341212f94480af4e99a44d842a4f, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.878335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.890985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:11.892327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:11.895986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1024/2080] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:11 2022] PUT /identity/v3/projects/0a10b8090f2e41a6aabed8d02c3b2d61/users/a48a341212f94480af4e99a44d842a4f/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:11.897833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.967308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1057/2081] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:11.967807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:11.977259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe06bb-69c4-4739-aabc-541d56894d84 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.982657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902fa2c-2c78-44de-b2fd-fa4de1896077 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:11.983546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.984351 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.984854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.985732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.987131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:11.987954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.988436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:11.989102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:11.989393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:11.989668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:11.990312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:11.990590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:11.991958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.005598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1025/2082] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:12.006536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1058/2083] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:12.009372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.010893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.021645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfbe7f-d6de-482e-b570-0a75c69afbb4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.023413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b684e-ad81-4d9c-b414-af892fe6fea8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.026618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d417d-a3b6-4493-9ac7-2036a578ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.027434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d417d-a3b6-4493-9ac7-2036a578ba60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.027843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d417d-a3b6-4493-9ac7-2036a578ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.028211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d417d-a3b6-4493-9ac7-2036a578ba60 admin admin] PATH_INFO: `/v3/projects/0a10b8090f2e41a6aabed8d02c3b2d61/users/a48a341212f94480af4e99a44d842a4f/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.028691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.029870 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.030563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.030695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d417d-a3b6-4493-9ac7-2036a578ba60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a10b8090f2e41a6aabed8d02c3b2d61, user_id=a48a341212f94480af4e99a44d842a4f, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.030880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.031375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.033390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d417d-a3b6-4493-9ac7-2036a578ba60 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.033742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.045178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1026/2084] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:12 2022] PUT /identity/v3/projects/0a10b8090f2e41a6aabed8d02c3b2d61/users/a48a341212f94480af4e99a44d842a4f/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:12.055998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.056502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.056943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.075090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1059/2085] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:12 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:12.080072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.087576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] MFA Rules not processed for user `a48a341212f94480af4e99a44d842a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:12.088940 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:12.150017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8eeec4-adb0-46ed-a8e6-15a6e90c6ff7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.154715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.155320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.155625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.155897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.156538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.158590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.164538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:12.169800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1027/2086] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:12.181288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.182674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:12.189442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1060/2087] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:12 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:12.190899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.201435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14da18-6033-4f48-bb4f-64fbfaef7e82 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.206600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.207275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.207629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.208005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.208778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.210415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.223015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1061/2088] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:12.226832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.237873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980d1c7-e8bf-47bc-b622-cfdac728c34f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.243836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b37a8-a661-4f6c-b206-95134d82077e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.247749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.248418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.248994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.249275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.251658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:12.254064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.254612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.254991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.255219 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.255851 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.257500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.270922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1062/2089] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:12.274947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.286696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2700e9-2d14-43a9-81cb-864e045d222a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.292433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2c236-55fb-4d3a-a336-c8cee6d28ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.293624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c236-55fb-4d3a-a336-c8cee6d28ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.294757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c236-55fb-4d3a-a336-c8cee6d28ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.295682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2c236-55fb-4d3a-a336-c8cee6d28ed9 admin admin] PATH_INFO: `/v3/projects/1b75c28463dd4fd4a68feaac7bcb84cb/users/9afd25689e6343b69c45fb01da635126/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.316840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2c236-55fb-4d3a-a336-c8cee6d28ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b75c28463dd4fd4a68feaac7bcb84cb, user_id=9afd25689e6343b69c45fb01da635126, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.319915 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2c236-55fb-4d3a-a336-c8cee6d28ed9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.322841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:12.331490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.334010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.340801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1063/2090] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:12 2022] PUT /identity/v3/projects/1b75c28463dd4fd4a68feaac7bcb84cb/users/9afd25689e6343b69c45fb01da635126/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:12.349716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.350118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.352229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.355258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1028/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:12.407356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] MFA Rules not processed for user `9afd25689e6343b69c45fb01da635126`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:12.408844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:12.559487 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1064/2092] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:12.567681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.599683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a115d-afc8-4f39-9204-a0e7f3749795 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.689313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.691708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.692249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.693616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.695612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.699685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.736559 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1029/2093] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:12 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:12.740979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.773767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba34ca0-a354-4491-b98a-b827214d1460 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.878948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.880315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.880605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.880880 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.882022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.883742 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.915276 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1065/2094] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:12 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:12.921023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:12.935283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd2453-f740-4229-8430-39ee3f4a215f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:12.953287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:12.953901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:12.955486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:12.956893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:12.958090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:12.960231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:12.990060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1030/2095] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:12.994635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:13.020669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058d0c6-89c5-4770-9a6e-8c76be7ad0a4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:13.028394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:13.030365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:13.031167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:13.034282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] PATH_INFO: `/v3/projects/b089f3781d514d18a011473a28f64858/users/3ce102b2a9db486abf2efd5c8701133d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:13.058244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b089f3781d514d18a011473a28f64858, user_id=3ce102b2a9db486abf2efd5c8701133d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:13.061214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:13.077909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1066/2096] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:12 2022] PUT /identity/v3/projects/b089f3781d514d18a011473a28f64858/users/3ce102b2a9db486abf2efd5c8701133d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:13.082308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:13.095583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccde9e-64c0-4ac0-b1ae-294548baa39d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:13.124961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:13.161644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39858f-035d-4365-93f6-0b2ad6326317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:13.162311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39858f-035d-4365-93f6-0b2ad6326317 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:13.162616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39858f-035d-4365-93f6-0b2ad6326317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:13.162892 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39858f-035d-4365-93f6-0b2ad6326317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:13.163528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39858f-035d-4365-93f6-0b2ad6326317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:13.165171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39858f-035d-4365-93f6-0b2ad6326317 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:13.175250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1031/2097] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:13.179442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:13.191622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac8648-1949-4379-8841-8f79fdb35f20 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:13.197500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:13.198644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:13.198941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:13.199213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] PATH_INFO: `/v3/projects/b089f3781d514d18a011473a28f64858/users/3ce102b2a9db486abf2efd5c8701133d/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:13.201575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b089f3781d514d18a011473a28f64858, user_id=3ce102b2a9db486abf2efd5c8701133d, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:13.204558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:13.215796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1067/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:13 2022] PUT /identity/v3/projects/b089f3781d514d18a011473a28f64858/users/3ce102b2a9db486abf2efd5c8701133d/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:13.226873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:13.227288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:13.227495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:13.259217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] MFA Rules not processed for user `3ce102b2a9db486abf2efd5c8701133d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:13.260466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:13.335506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1032/2099] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:13.347787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:13.390330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:13.412297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8821dd6-2367-408e-86b1-eec727a3b753 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:13.416682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:13.417286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:13.417562 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:13.418056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:13.429040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:13.430495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:13.440566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1068/2100] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:13.534674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:13.548148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa388b3-912e-42bf-b3bb-cba2d941bb6f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:13.551860 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:13.552538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:13.552814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:13.553083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:13.625522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:13.626954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:13.636660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1033/2101] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:14.126713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:14.129869 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:14.414447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a99c6-bbbb-45e8-a299-1f5b518bc6aa service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:14.421094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:14.421641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:14.422024 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:14.422399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] PATH_INFO: `/v3/users/4744d4f25bf6454480e4d54a1a04229d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:14.423957 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4744d4f25bf6454480e4d54a1a04229d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:14.426587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:14.489900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:14.492437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:14.519822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4744d4f25bf6454480e4d54a1a04229d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:14.520420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a56b140-7ea6-4e9c-b4e8-74bb1bbccc2b service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:14.534012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4744d4f25bf6454480e4d54a1a04229d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:14.534898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4744d4f25bf6454480e4d54a1a04229d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:14.535450 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:14.535600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4744d4f25bf6454480e4d54a1a04229d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:14.536149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:14.536431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:14.536706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:14.541183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:14.550478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3bc3007a-1e07-4ed0-8c8f-c080a1d7601c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4744d4f25bf6454480e4d54a1a04229d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:14.586632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1069/2102] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:14 2022] DELETE /identity/v3/users/4744d4f25bf6454480e4d54a1a04229d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:14.589456 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:14.590508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:14.591033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:14.634402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:14.635749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:14.647663 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:14.664844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:14.667850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:14.687344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1034/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:14.753344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:14.770743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1070/2104] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:14.814817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:14.817870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:14.901783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251ab8-e6af-4484-89a0-945b23d8246a service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:14.986813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:14.987781 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:14.988145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:14.988418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:15.004806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:15.006847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:15.020693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1035/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:15.487676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:15.489404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:15.523372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:15.525595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:15.546684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ca3e1-cf69-42a6-9824-0a67810a6c75 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:15.558066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:15.558728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:15.558990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:15.559247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] PATH_INFO: `/v3/projects/8989b2ca87b74898875114ddf4a31a0d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:15.563309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8989b2ca87b74898875114ddf4a31a0d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:15.568331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:15.601778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85076ec-cfc8-4c2f-b4ff-6c02668f2f05 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:15.605948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:15.606960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:15.607332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:15.607511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:15.609373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:15.673193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8989b2ca87b74898875114ddf4a31a0d', 'request_id': 'req-b2e13347-6e02-430c-bd16-17880c473c14'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:15.687356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8989b2ca87b74898875114ddf4a31a0d', 'request_id': 'req-b2e13347-6e02-430c-bd16-17880c473c14'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:15.703481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8989b2ca87b74898875114ddf4a31a0d', 'request_id': 'req-b2e13347-6e02-430c-bd16-17880c473c14'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:15.726823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:15.728391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429af612-32bc-4e8f-98f2-ea460c115ccb service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:15.729451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] The token cache is being invalidate because project 8989b2ca87b74898875114ddf4a31a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:15.730112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:15.730978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:15.735330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1036/2106] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:15 2022] DELETE /identity/v3/projects/8989b2ca87b74898875114ddf4a31a0d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:15.737120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:15.740635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:15.748549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1071/2107] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:15.750259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbde62-295b-4f28-a4f3-feef51f7a877 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:15.750947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbde62-295b-4f28-a4f3-feef51f7a877 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:15.750947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbde62-295b-4f28-a4f3-feef51f7a877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:15.777467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a2cbde62-295b-4f28-a4f3-feef51f7a877 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:15.779905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a2cbde62-295b-4f28-a4f3-feef51f7a877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:15.814163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:15.865923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e13347-6e02-430c-bd16-17880c473c14 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:15.872909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:15.874421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:15.874772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:15.876073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] PATH_INFO: `/v3/users/ec02c554ca304fc6a322cc0adf89a9a2` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:15.881158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec02c554ca304fc6a322cc0adf89a9a2)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:15.883518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:15.942078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1072/2108] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:15.960711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:15.961362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:15.961796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:15.988269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec02c554ca304fc6a322cc0adf89a9a2'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:15.992673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:15.994426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:16.000039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec02c554ca304fc6a322cc0adf89a9a2'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:16.001415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec02c554ca304fc6a322cc0adf89a9a2'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:16.002395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec02c554ca304fc6a322cc0adf89a9a2'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:16.011844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1073/2109] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:16.013722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.018110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-adaf5f22-7330-4409-b874-a9147cb6d1cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec02c554ca304fc6a322cc0adf89a9a2'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:16.032753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba454c74-2979-4878-ab0c-5561d3322c13 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.037995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.038859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.039153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.039435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.040186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:16.040497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.042728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.052822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1037/2110] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:15 2022] DELETE /identity/v3/users/ec02c554ca304fc6a322cc0adf89a9a2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:16.056661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.056998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.057626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.062029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1074/2111] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:16.063104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.073820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f871-e431-475c-8908-8004158d9920 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.089300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:16.091656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:16.131527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:16.170609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.171125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.171438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.171718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.172388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.174289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.178462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1038/2112] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:16.189207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.190732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:16.205027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1075/2113] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:16 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:16.209107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.259393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:16.264774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7290d-444e-4a45-8eef-c03003977fcb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.280298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c966f-5b08-442b-ab0a-8cecb1c84055 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.285528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.286390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.286682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.286960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.287605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.289564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.316590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1076/2114] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:16 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:16.320692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.324307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.325231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.325518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.325791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.331616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd7c2a-daf6-4ea2-8c8c-898dcd2b6fea admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.337589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.338619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.339476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.339610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.339860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.340094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.341411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.343792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.352401 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1039/2115] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:16.361032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1077/2116] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:16.362956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.375927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e32b-0cd9-47ac-8a10-b8135c50991e service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.382881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47a427-ccd1-4cb9-aaab-acd80563c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.383168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47a427-ccd1-4cb9-aaab-acd80563c698 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.383509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47a427-ccd1-4cb9-aaab-acd80563c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.383791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47a427-ccd1-4cb9-aaab-acd80563c698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.384482 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47a427-ccd1-4cb9-aaab-acd80563c698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.386089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47a427-ccd1-4cb9-aaab-acd80563c698 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.401204 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1040/2117] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:16.405990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.419550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c8892-2c51-4d03-b03c-4e5df66afc1e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.426065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.426790 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.427490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.427605 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] PATH_INFO: `/v3/projects/6b1900ad3dec447ca2f6d78df616eb2c/users/a71e979e741e4635a754444360a7eb0e/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.445103 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1900ad3dec447ca2f6d78df616eb2c, user_id=a71e979e741e4635a754444360a7eb0e, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.448092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.467066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1078/2118] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:16 2022] PUT /identity/v3/projects/6b1900ad3dec447ca2f6d78df616eb2c/users/a71e979e741e4635a754444360a7eb0e/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:16.477604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.477881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.478233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.509657 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] MFA Rules not processed for user `a71e979e741e4635a754444360a7eb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:16.510876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:16.583903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1041/2119] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:16.592760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.594922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:16.669320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676990-ecd7-42ff-ba16-d92ad9b9f86b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.673288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.673893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.674951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.675237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.686338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.687779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.697694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1079/2120] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:16.780783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:16.782549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:16.913835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665281-f678-40f7-9a43-5c65e4eb6b43 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:16.918685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:16.920133 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:16.920515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:16.920832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] PATH_INFO: `/v3/projects/4b0351ff514e4ff8a616afdecbb1b7c6` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:16.922183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0351ff514e4ff8a616afdecbb1b7c6)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:16.924378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:16.988725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:17.036852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0351ff514e4ff8a616afdecbb1b7c6', 'request_id': 'req-004a85fa-2208-4611-9b86-f99884db0355'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.046382 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0351ff514e4ff8a616afdecbb1b7c6', 'request_id': 'req-004a85fa-2208-4611-9b86-f99884db0355'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.055067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0351ff514e4ff8a616afdecbb1b7c6', 'request_id': 'req-004a85fa-2208-4611-9b86-f99884db0355'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.082584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] The token cache is being invalidate because project 4b0351ff514e4ff8a616afdecbb1b7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:17.082878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.083543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.085363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1042/2121] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:16 2022] DELETE /identity/v3/projects/4b0351ff514e4ff8a616afdecbb1b7c6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:17.089029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:17.122704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b499c-1f23-405d-a725-bb7c8d4b152b service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:17.136697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:17.281087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:17.282189 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:17.282669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:17.283099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] PATH_INFO: `/v3/users/b41bcd373e09434b9170f4d8e809debc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:17.285210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41bcd373e09434b9170f4d8e809debc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:17.289320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:17.377847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41bcd373e09434b9170f4d8e809debc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.397424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41bcd373e09434b9170f4d8e809debc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.399315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41bcd373e09434b9170f4d8e809debc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.400741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41bcd373e09434b9170f4d8e809debc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.415890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41bcd373e09434b9170f4d8e809debc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.442265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1080/2122] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:17 2022] DELETE /identity/v3/users/b41bcd373e09434b9170f4d8e809debc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:17.749684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:17.751433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:17.765777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a85fa-2208-4611-9b86-f99884db0355 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:17.831296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:17.832107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:17.832560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:17.832907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] PATH_INFO: `/v3/projects/0423b572853245fdbbaf4e9e57f2b639` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:17.834870 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0423b572853245fdbbaf4e9e57f2b639)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:17.837582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:17.898747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0423b572853245fdbbaf4e9e57f2b639', 'request_id': 'req-91a0714b-c892-4da8-a99a-ff8a2a6fd592'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.907636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0423b572853245fdbbaf4e9e57f2b639', 'request_id': 'req-91a0714b-c892-4da8-a99a-ff8a2a6fd592'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.914521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0423b572853245fdbbaf4e9e57f2b639', 'request_id': 'req-91a0714b-c892-4da8-a99a-ff8a2a6fd592'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.929793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] The token cache is being invalidate because project 0423b572853245fdbbaf4e9e57f2b639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:17.930321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.931238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-91a0714b-c892-4da8-a99a-ff8a2a6fd592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:17.932853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1043/2123] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:17 2022] DELETE /identity/v3/projects/0423b572853245fdbbaf4e9e57f2b639 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:17.937515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:17.939095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:17.967589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700be631-4ec6-4551-a86c-828689288dd0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:18.031297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:18.031778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:18.032093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:18.032370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] PATH_INFO: `/v3/users/eb7c428ae6d34c54b4f3c9af8ee56784` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:18.033604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7c428ae6d34c54b4f3c9af8ee56784)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:18.037894 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:18.077224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:18.104590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7c428ae6d34c54b4f3c9af8ee56784'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:18.113383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7c428ae6d34c54b4f3c9af8ee56784'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:18.114182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7c428ae6d34c54b4f3c9af8ee56784'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:18.114893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7c428ae6d34c54b4f3c9af8ee56784'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:18.123924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7c428ae6d34c54b4f3c9af8ee56784'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:18.153353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1081/2124] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:17 2022] DELETE /identity/v3/users/eb7c428ae6d34c54b4f3c9af8ee56784 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:18.291138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925c49-ba9e-4fdc-85bf-348006e21afa None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:18.291431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925c49-ba9e-4fdc-85bf-348006e21afa None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:18.291716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925c49-ba9e-4fdc-85bf-348006e21afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:18.313388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-39925c49-ba9e-4fdc-85bf-348006e21afa None None] MFA Rules not processed for user `a71e979e741e4635a754444360a7eb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:18.314837 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-39925c49-ba9e-4fdc-85bf-348006e21afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:18.362817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:18.380896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1044/2125] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:18.913113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:18.914905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.042227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1f0e5-2ec6-435a-a6f5-364e1abbadd6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.048133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.048966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.049626 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.050094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] PATH_INFO: `/v3/projects/8a62914396964e8db647ae27eae44c4b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.051380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a62914396964e8db647ae27eae44c4b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.053656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.118507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a62914396964e8db647ae27eae44c4b', 'request_id': 'req-b03e4248-2bcc-4725-bcfd-4502df4a27e6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.128524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a62914396964e8db647ae27eae44c4b', 'request_id': 'req-b03e4248-2bcc-4725-bcfd-4502df4a27e6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.141020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a62914396964e8db647ae27eae44c4b', 'request_id': 'req-b03e4248-2bcc-4725-bcfd-4502df4a27e6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.156698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] The token cache is being invalidate because project 8a62914396964e8db647ae27eae44c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:19.156997 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.157659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.159563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1082/2126] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:18 2022] DELETE /identity/v3/projects/8a62914396964e8db647ae27eae44c4b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:19.165029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d9c2-e122-4a7f-a456-7d56ca977f8a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.165029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d9c2-e122-4a7f-a456-7d56ca977f8a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.165624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d9c2-e122-4a7f-a456-7d56ca977f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.194377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e6e9d9c2-e122-4a7f-a456-7d56ca977f8a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:19.195604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e6e9d9c2-e122-4a7f-a456-7d56ca977f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.252085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.253576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.275764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1045/2127] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:19.277227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.277522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.277803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.300213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:19.301421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.302698 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:19.310578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1046/2128] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:19.314992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.324565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd0def-ce43-4b53-8416-04decf52b2f7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.328429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4248-2bcc-4725-bcfd-4502df4a27e6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.330601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.331339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.331629 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.331975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.332785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:19.333195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.333642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.334392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.334711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.334979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.335083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] PATH_INFO: `/v3/users/9afd25689e6343b69c45fb01da635126` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.336072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afd25689e6343b69c45fb01da635126)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.337999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.353229 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1047/2129] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:13:19.354407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.366607 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d4370-fbe7-4f08-ae4c-5f0395be4bc4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.371637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.372305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.372609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.372864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.373491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.375398 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.393011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afd25689e6343b69c45fb01da635126'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.401003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afd25689e6343b69c45fb01da635126'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.402035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afd25689e6343b69c45fb01da635126'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.402835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afd25689e6343b69c45fb01da635126'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.413592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1048/2130] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:19 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:19.414295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-921e77e0-167d-41e5-817f-5e899e63f6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afd25689e6343b69c45fb01da635126'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:19.414779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.416900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.436198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1083/2131] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:19 2022] DELETE /identity/v3/users/9afd25689e6343b69c45fb01da635126 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:19.441756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.442517 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.442952 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.475674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:19.476932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.510496 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2e21d-4aca-4060-a6be-b71089050f77 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.579732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1084/2132] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:19.584058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:19.593183 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.593744 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.594291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.594858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.595390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.595983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.596429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.599611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.632480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1049/2133] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:19 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:19.636728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.651375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e38772-b7f8-43c4-810f-aa1f938b3c60 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.656843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.657549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.657995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.658279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.659051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.661396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.676530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1050/2134] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:19.689813 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09bc6-02ca-4ec0-8378-26206765519c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.692151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.694815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.696021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.696545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.697094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.707154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb263fad-76d4-4a31-b597-3a2fc4cbd084 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.710602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.712432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.713361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19929bbc-22d1-4b4e-b505-28d56820f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.714078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19929bbc-22d1-4b4e-b505-28d56820f315 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.714354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19929bbc-22d1-4b4e-b505-28d56820f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.714626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19929bbc-22d1-4b4e-b505-28d56820f315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.715489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19929bbc-22d1-4b4e-b505-28d56820f315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.717842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19929bbc-22d1-4b4e-b505-28d56820f315 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.725796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1085/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:19.733284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1051/2136] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:19.737912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.742706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:19.747904 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f877793-0978-4eee-9e86-931ad57fff65 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:19.754907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:19.756211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.756489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.756825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] PATH_INFO: `/v3/projects/f22ab6f95b884f7bb39f46b665efe0ac/users/24e84db753a742d0a71913ad5a08596c/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.773707 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22ab6f95b884f7bb39f46b665efe0ac, user_id=24e84db753a742d0a71913ad5a08596c, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:19.776826 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:19.798956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1086/2137] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:19 2022] PUT /identity/v3/projects/f22ab6f95b884f7bb39f46b665efe0ac/users/24e84db753a742d0a71913ad5a08596c/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:19.809206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:19.809543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:19.809817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:19.851197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] MFA Rules not processed for user `24e84db753a742d0a71913ad5a08596c`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:19.852722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:19.979912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1052/2138] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:19 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:19.991480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:19.993925 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:20.106090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:20.107717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:20.188414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9096-f3f5-4a3e-8200-bb7090d301da admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:20.192770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:20.193390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:20.193676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:20.193951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:20.205450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:20.206902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:20.218404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1087/2139] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:20.219021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:20.220900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:20.231646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12236e7f-1605-4f3d-a22c-4e195af3aac1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:20.238273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:20.238774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:20.239099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db04b-29ae-4402-bc8b-6f8db38e6271 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:20.239234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:20.239610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] PATH_INFO: `/v3/users/16253010435d40618ab64ba3501d0e3b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:20.240997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16253010435d40618ab64ba3501d0e3b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:20.243581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:20.245932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:20.246577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:20.247548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:20.247834 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] PATH_INFO: `/v3/projects/1b75c28463dd4fd4a68feaac7bcb84cb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:20.249278 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b75c28463dd4fd4a68feaac7bcb84cb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:20.251254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:20.329180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b75c28463dd4fd4a68feaac7bcb84cb', 'request_id': 'req-daf882fa-835a-4920-954f-e8b2859a48b6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.335165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16253010435d40618ab64ba3501d0e3b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.338640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b75c28463dd4fd4a68feaac7bcb84cb', 'request_id': 'req-daf882fa-835a-4920-954f-e8b2859a48b6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.348271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b75c28463dd4fd4a68feaac7bcb84cb', 'request_id': 'req-daf882fa-835a-4920-954f-e8b2859a48b6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.350533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16253010435d40618ab64ba3501d0e3b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.351679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16253010435d40618ab64ba3501d0e3b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.352583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16253010435d40618ab64ba3501d0e3b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.355163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:20.366742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ce3ba1f8-53ce-4f20-887e-86b5a5a72104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16253010435d40618ab64ba3501d0e3b'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.371408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] The token cache is being invalidate because project 1b75c28463dd4fd4a68feaac7bcb84cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:20.372394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.373156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.374916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1088/2140] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:20 2022] DELETE /identity/v3/projects/1b75c28463dd4fd4a68feaac7bcb84cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:20.379655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:20.381297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:20.395967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1053/2141] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:20 2022] DELETE /identity/v3/users/16253010435d40618ab64ba3501d0e3b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:20.400143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:20.400727 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:20.401432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:20.427160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:20.428411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:20.463688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf882fa-835a-4920-954f-e8b2859a48b6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:20.475092 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:20.505758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1054/2142] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:20.511898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:20.514275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:20.601413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:20.603296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:20.604018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:20.604163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] PATH_INFO: `/v3/users/3ce102b2a9db486abf2efd5c8701133d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:20.605502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce102b2a9db486abf2efd5c8701133d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:20.608658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:20.651894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493ce12-6d91-4435-b0aa-0e8bd4be4044 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:20.656549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:20.657761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:20.659577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:20.660047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:20.674117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:20.676017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:20.688708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1055/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:20.727426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce102b2a9db486abf2efd5c8701133d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.760508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce102b2a9db486abf2efd5c8701133d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.763372 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce102b2a9db486abf2efd5c8701133d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.764290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce102b2a9db486abf2efd5c8701133d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.778866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce102b2a9db486abf2efd5c8701133d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:20.824001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1089/2144] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:20 2022] DELETE /identity/v3/users/3ce102b2a9db486abf2efd5c8701133d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:21.566618 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:21.568158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:21.583894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580a658-279f-4d6e-a0c2-0bd5b014bf00 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:21.660495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:21.662513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:21.672139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:21.672838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:21.673120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:21.673508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] PATH_INFO: `/v3/projects/e6ae86df6cc040e0902b747c03304424` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:21.676121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ae86df6cc040e0902b747c03304424)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:21.679630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:21.719341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:21.747675 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c3114-9321-48eb-8fac-c0007aff0f55 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:21.752597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ae86df6cc040e0902b747c03304424', 'request_id': 'req-98e27aab-6078-457b-af45-b440cc587a13'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.765488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ae86df6cc040e0902b747c03304424', 'request_id': 'req-98e27aab-6078-457b-af45-b440cc587a13'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.774714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ae86df6cc040e0902b747c03304424', 'request_id': 'req-98e27aab-6078-457b-af45-b440cc587a13'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.790997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] The token cache is being invalidate because project e6ae86df6cc040e0902b747c03304424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:21.791297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.792186 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.795092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1056/2145] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:21 2022] DELETE /identity/v3/projects/e6ae86df6cc040e0902b747c03304424 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:21.799310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:21.800769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:21.804269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:21.835224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:21.836128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:21.836474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:21.836810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] PATH_INFO: `/v3/projects/b089f3781d514d18a011473a28f64858` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:21.838558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b089f3781d514d18a011473a28f64858)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:21.840739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:21.905529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e27aab-6078-457b-af45-b440cc587a13 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:21.931898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b089f3781d514d18a011473a28f64858', 'request_id': 'req-d8746efb-91f4-447f-a7a5-e1db0ce358c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.969687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b089f3781d514d18a011473a28f64858', 'request_id': 'req-d8746efb-91f4-447f-a7a5-e1db0ce358c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.984144 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b089f3781d514d18a011473a28f64858', 'request_id': 'req-d8746efb-91f4-447f-a7a5-e1db0ce358c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:21.988510 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:21.989368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:21.990205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:21.990620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] PATH_INFO: `/v3/users/2b12e4567c8a41a290e1d4af5ad66f75` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:21.993191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b12e4567c8a41a290e1d4af5ad66f75)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:21.997679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.005567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] The token cache is being invalidate because project b089f3781d514d18a011473a28f64858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:22.005881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.011022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8746efb-91f4-447f-a7a5-e1db0ce358c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.013608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1090/2146] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:21 2022] DELETE /identity/v3/projects/b089f3781d514d18a011473a28f64858 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:22.018618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c496-8679-4ca7-88ba-fe57bb91adc8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.019125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c496-8679-4ca7-88ba-fe57bb91adc8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.019546 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42c496-8679-4ca7-88ba-fe57bb91adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.049888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9c42c496-8679-4ca7-88ba-fe57bb91adc8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:22.051435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9c42c496-8679-4ca7-88ba-fe57bb91adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:22.061798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1091/2147] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:22.070229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.070731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.071207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.095948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:22.097656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:22.111041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1092/2148] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:22.115691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.118475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b12e4567c8a41a290e1d4af5ad66f75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.129511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c1a3c-a8f6-4f84-9e9c-dbcab1497f89 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:22.137297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:22.138943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b12e4567c8a41a290e1d4af5ad66f75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.139697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.141134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b12e4567c8a41a290e1d4af5ad66f75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.141395 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.142554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.143015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b12e4567c8a41a290e1d4af5ad66f75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.144602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:22.147419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:22.147554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:22.149706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.165194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b12e4567c8a41a290e1d4af5ad66f75'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:22.189478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1093/2149] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:22.194497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.202979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:22.215325 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1057/2150] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:21 2022] DELETE /identity/v3/users/2b12e4567c8a41a290e1d4af5ad66f75 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:22.239313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94579e73-7aed-46fc-84d0-d2230ea18450 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:22.407308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:22.409133 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.409492 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.409723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.413262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:22.416501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.477723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1094/2151] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:22 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:22.481699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.492754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd560da-cb27-46af-8506-b3636755291f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:22.566585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:22.567207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.567752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.567752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.568438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:22.573391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.601494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1058/2152] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:22 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:22.606798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.622838 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d33d8f-0467-4fad-99fc-25cf8c4bbb8c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:22.629360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:22.630267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.630663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.631072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.632500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:22.635025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.648874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1095/2153] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:22.652769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.664960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9be0e-fe06-47e1-8079-6bb61cf07d93 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:22.670515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e40fe-4a94-4111-893a-1e5c7964f2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:22.671426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e40fe-4a94-4111-893a-1e5c7964f2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.671568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e40fe-4a94-4111-893a-1e5c7964f2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.671812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e40fe-4a94-4111-893a-1e5c7964f2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.672493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e40fe-4a94-4111-893a-1e5c7964f2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:22.674303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e40fe-4a94-4111-893a-1e5c7964f2ae admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.690596 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1059/2154] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:22.707658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.723002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1106-c9c8-4ad6-941e-491ec94da467 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:22.734027 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:22.736210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.736612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.737814 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] PATH_INFO: `/v3/projects/3787be30fbad4e2099c09d3e419391cc/users/28e0ab09119d4057b55d5135f8b25204/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.757146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:22.767344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3787be30fbad4e2099c09d3e419391cc, user_id=28e0ab09119d4057b55d5135f8b25204, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:22.769770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:22.789297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1096/2155] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:22 2022] PUT /identity/v3/projects/3787be30fbad4e2099c09d3e419391cc/users/28e0ab09119d4057b55d5135f8b25204/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:22.799196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:22.803434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:22.803434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:22.851900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] MFA Rules not processed for user `28e0ab09119d4057b55d5135f8b25204`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:22.853134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:22.932045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1060/2156] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:22.944597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:22.953461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:23.015012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ed8f1-685f-4d9a-8e7a-03ae7e8b85e4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:23.018974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:23.019569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:23.019846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:23.020146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:23.028943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:23.030141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:23.039622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1097/2157] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:23.052575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:23.054614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:23.145518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:23.168089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9068d1e-5a24-474f-9ff7-d2ea3ab575b4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:23.173469 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:23.173847 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:23.174181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:23.174550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] PATH_INFO: `/v3/projects/28cad7877af2437a8c61057ff42d684c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:23.175766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28cad7877af2437a8c61057ff42d684c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:23.177761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:23.231555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28cad7877af2437a8c61057ff42d684c', 'request_id': 'req-f3cbfc90-f664-4240-ba4a-d4d34f38c662'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.239530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28cad7877af2437a8c61057ff42d684c', 'request_id': 'req-f3cbfc90-f664-4240-ba4a-d4d34f38c662'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.246084 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28cad7877af2437a8c61057ff42d684c', 'request_id': 'req-f3cbfc90-f664-4240-ba4a-d4d34f38c662'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.257644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] The token cache is being invalidate because project 28cad7877af2437a8c61057ff42d684c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:23.257935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.258572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.260081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1061/2158] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:23 2022] DELETE /identity/v3/projects/28cad7877af2437a8c61057ff42d684c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:23.264665 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:23.275799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9553a-65cb-4d79-8d02-592f6bda560c service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:23.332566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:23.333172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:23.333447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:23.333716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] PATH_INFO: `/v3/users/a48a341212f94480af4e99a44d842a4f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:23.334981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48a341212f94480af4e99a44d842a4f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:23.336937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:23.391261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48a341212f94480af4e99a44d842a4f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.402095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48a341212f94480af4e99a44d842a4f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.403392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48a341212f94480af4e99a44d842a4f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.409292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48a341212f94480af4e99a44d842a4f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.420805 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa3aa7f6-603e-4d18-9b99-894058e50e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48a341212f94480af4e99a44d842a4f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:23.445151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1098/2159] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:23 2022] DELETE /identity/v3/users/a48a341212f94480af4e99a44d842a4f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:24.157279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.158904 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:24.173910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbfc90-f664-4240-ba4a-d4d34f38c662 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.233120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.233743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.234024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.234298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] PATH_INFO: `/v3/projects/0a10b8090f2e41a6aabed8d02c3b2d61` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.235428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a10b8090f2e41a6aabed8d02c3b2d61)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.237601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.284848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a10b8090f2e41a6aabed8d02c3b2d61', 'request_id': 'req-ed9b7d85-55b7-4c4b-878c-c055ea064d49'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:24.294002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a10b8090f2e41a6aabed8d02c3b2d61', 'request_id': 'req-ed9b7d85-55b7-4c4b-878c-c055ea064d49'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:24.300952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a10b8090f2e41a6aabed8d02c3b2d61', 'request_id': 'req-ed9b7d85-55b7-4c4b-878c-c055ea064d49'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:24.312859 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] The token cache is being invalidate because project 0a10b8090f2e41a6aabed8d02c3b2d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:24.313166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:24.313815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-ed9b7d85-55b7-4c4b-878c-c055ea064d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:24.315652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1062/2160] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:24 2022] DELETE /identity/v3/projects/0a10b8090f2e41a6aabed8d02c3b2d61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:24.320175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.320641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.320810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.343081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:24.344388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:24.353361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:24.409151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1099/2161] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:24.416842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.417138 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.417417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.425846 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:24.441644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:24.442549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:24.453931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1063/2162] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:24.458380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.468733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74f44-e85d-42a9-aba9-f587bc16c4f5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.473389 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.473990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.474275 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.474545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.475305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:24.475612 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.477228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.490969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1100/2163] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:13:24.496471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.506438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d7f11-8713-4cfe-ad9f-dd841c018b21 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.511741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.512443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.512725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.512999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.513647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.515528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.550579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1064/2164] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:24 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:24.554624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.566716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf10e6-38a5-4de1-bbc4-eb0e232a6e2b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.661986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.662830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.663209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.663575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.664406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.668329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.707230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1101/2165] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:24 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:24.708533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.721759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e25b2-39fe-4187-9e59-50c652b03900 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.726963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.727670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.728050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.728399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.729111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.730761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.761055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1065/2166] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:24.765919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.778361 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2963361-896a-450e-bb97-a4777a002434 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.785697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a20e-a111-409f-a08d-61eeb8d6ef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.786458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a20e-a111-409f-a08d-61eeb8d6ef67 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.786741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a20e-a111-409f-a08d-61eeb8d6ef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.787014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a20e-a111-409f-a08d-61eeb8d6ef67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.787657 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a20e-a111-409f-a08d-61eeb8d6ef67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.789271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a20e-a111-409f-a08d-61eeb8d6ef67 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.801711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1102/2167] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:13:24.805626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:24.817241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5c828-f8c7-4424-9e93-56d90247248b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:24.822746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:24.823603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.824168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.824280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] PATH_INFO: `/v3/projects/290f23e2a5cc43659f5b4452361a2b0f/users/1c1404a92b8345fa9e0c32485b198aa7/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.853113 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290f23e2a5cc43659f5b4452361a2b0f, user_id=1c1404a92b8345fa9e0c32485b198aa7, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:24.856222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:24.875457 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1066/2168] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:24 2022] PUT /identity/v3/projects/290f23e2a5cc43659f5b4452361a2b0f/users/1c1404a92b8345fa9e0c32485b198aa7/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:24.886996 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:24.888729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:24.889032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:24.923052 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] MFA Rules not processed for user `1c1404a92b8345fa9e0c32485b198aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:24.924625 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:25.014188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1103/2169] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:25.026128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:25.028514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:25.094109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8193c-8de8-46fd-a062-2868833a1808 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:25.097896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ab77-3836-4635-9842-f48a62fe2ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:25.098803 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ab77-3836-4635-9842-f48a62fe2ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:25.099161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ab77-3836-4635-9842-f48a62fe2ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:25.099501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ab77-3836-4635-9842-f48a62fe2ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:25.112835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101ab77-3836-4635-9842-f48a62fe2ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:25.112835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101ab77-3836-4635-9842-f48a62fe2ff7 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:25.121782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1067/2170] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:25.787734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:25.789190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:25.799890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:25.855983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da17ee-9eab-4d49-8dcd-0e4e7efd1284 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:25.860807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:25.861489 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:25.861773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:25.862069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] PATH_INFO: `/v3/users/24e84db753a742d0a71913ad5a08596c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:25.863553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e84db753a742d0a71913ad5a08596c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:25.866023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:25.914117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e84db753a742d0a71913ad5a08596c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:25.921382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e84db753a742d0a71913ad5a08596c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:25.922067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e84db753a742d0a71913ad5a08596c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:25.922670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e84db753a742d0a71913ad5a08596c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:25.930633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e84db753a742d0a71913ad5a08596c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:25.949734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1104/2171] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:25 2022] DELETE /identity/v3/users/24e84db753a742d0a71913ad5a08596c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:25.955389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:25.956845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:25.957127 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:25.977745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:25.978960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:26.047096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1068/2172] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:26.057496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:26.059039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:26.125076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e357c-8866-4c3f-b1a7-35397e517640 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:26.129282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:26.130213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:26.130802 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:26.131254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:26.143251 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:26.145060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:26.156910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1105/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:26.484046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:26.501561 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:26.522388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac7e15-adf0-4146-b8d1-1072b84e23b9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:26.528824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:26.529918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:26.530896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:26.532027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] PATH_INFO: `/v3/projects/f22ab6f95b884f7bb39f46b665efe0ac` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:26.533404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22ab6f95b884f7bb39f46b665efe0ac)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:26.536029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:26.592721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:26.603828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22ab6f95b884f7bb39f46b665efe0ac', 'request_id': 'req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:26.611884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22ab6f95b884f7bb39f46b665efe0ac', 'request_id': 'req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:26.618433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22ab6f95b884f7bb39f46b665efe0ac', 'request_id': 'req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:26.633180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] The token cache is being invalidate because project f22ab6f95b884f7bb39f46b665efe0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:26.633472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:26.634115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-13f8ee64-0050-4777-83ba-a9ab0ac3bdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:26.635621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1069/2174] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:26 2022] DELETE /identity/v3/projects/f22ab6f95b884f7bb39f46b665efe0ac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:27.787237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:27.788692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:27.801538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535517d-2b49-463f-82d7-973e5ca31283 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:27.833377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:27.864632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:27.865410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:27.865697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:27.865979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] PATH_INFO: `/v3/users/1c1404a92b8345fa9e0c32485b198aa7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:27.867153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1404a92b8345fa9e0c32485b198aa7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:27.869740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:27.916300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1404a92b8345fa9e0c32485b198aa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:27.924993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1404a92b8345fa9e0c32485b198aa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:27.925672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1404a92b8345fa9e0c32485b198aa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:27.926282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1404a92b8345fa9e0c32485b198aa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:27.935061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1404a92b8345fa9e0c32485b198aa7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:27.961387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1106/2175] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:27 2022] DELETE /identity/v3/users/1c1404a92b8345fa9e0c32485b198aa7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:27.963609 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:27.965806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:27.966317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:27.988804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:27.990188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:28.055132 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1070/2176] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:28.068808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:28.070265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:28.143714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c93a0-aed9-4027-981e-ffe86646b115 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:28.148402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6363b-846b-4924-beaa-70ac0e5acfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:28.149026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6363b-846b-4924-beaa-70ac0e5acfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:28.149440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6363b-846b-4924-beaa-70ac0e5acfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:28.149773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6363b-846b-4924-beaa-70ac0e5acfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:28.161396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6363b-846b-4924-beaa-70ac0e5acfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:28.162956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6363b-846b-4924-beaa-70ac0e5acfa9 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:28.175056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1107/2177] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:28.502218 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:28.505281 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:28.545182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1ada-88bb-4fd7-b694-e462ad3a0a43 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:28.550932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:28.551570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:28.551851 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:28.552153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] PATH_INFO: `/v3/projects/290f23e2a5cc43659f5b4452361a2b0f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:28.553281 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] RBAC: Authorizing `identity:delete_project(project_id=290f23e2a5cc43659f5b4452361a2b0f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:28.555212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:28.616930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290f23e2a5cc43659f5b4452361a2b0f', 'request_id': 'req-cbce4593-5deb-41e8-a864-f6492827538c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:28.628610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290f23e2a5cc43659f5b4452361a2b0f', 'request_id': 'req-cbce4593-5deb-41e8-a864-f6492827538c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:28.636000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290f23e2a5cc43659f5b4452361a2b0f', 'request_id': 'req-cbce4593-5deb-41e8-a864-f6492827538c'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:28.663662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] The token cache is being invalidate because project 290f23e2a5cc43659f5b4452361a2b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:13:28.664142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:28.665049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-cbce4593-5deb-41e8-a864-f6492827538c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:28.666889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1071/2178] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:28 2022] DELETE /identity/v3/projects/290f23e2a5cc43659f5b4452361a2b0f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:28.676493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:28.676493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:28.676493 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:28.704423 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:28.705757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:28.755825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:28.772563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1108/2179] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:28.780276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:28.780646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:28.780988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:28.811140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:28.814025 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:28.823199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1072/2180] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:28.827227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:28.843110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f2e3f-fdb5-4267-a526-26cfac2776ae None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:28.848073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:28.848785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:28.849128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:28.849466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:28.850815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:13:28.851213 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:28.852918 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:28.888234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:28.912299 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde1f0b-06a0-417d-b42b-f72edf37420c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:28.912578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1109/2181] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:13:28.913811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:28.914458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:28.914767 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:28.919412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:28.919412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:28.920638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:28.985443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1073/2182] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:13:28 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:13:28.986843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:29.004474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ac3c5-976a-4b17-adb2-d98f7e631f23 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:29.108308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:29.109017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:29.109367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:29.110161 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:29.110565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:29.113180 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:29.140032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1110/2183] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:13:28 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:13:29.144043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:29.159400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73e409-fbbd-45e6-a46a-fa852701b6ca admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:29.166433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:29.167143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:29.168065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:29.169074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:29.169731 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:29.171499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:29.184051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1074/2184] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:29.187724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:29.199711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f4e3b-9249-43a0-a7a7-d911b81bfb86 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:29.204439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc243f-b721-4e9e-b09d-554e849a4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:29.205069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc243f-b721-4e9e-b09d-554e849a4778 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:29.205354 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc243f-b721-4e9e-b09d-554e849a4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:29.205630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc243f-b721-4e9e-b09d-554e849a4778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:29.206268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc243f-b721-4e9e-b09d-554e849a4778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:29.207861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc243f-b721-4e9e-b09d-554e849a4778 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:29.219076 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1111/2185] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:13:29.223365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:29.233911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3408a1-6aea-42fe-af87-8a42b550a3e6 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:29.238723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:29.239367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:29.239644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:29.239950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] PATH_INFO: `/v3/projects/1997467d3105460d8c4515da9964db35/users/06e1ca1b34ac47108d3799e0f94d1c40/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:29.242887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:29.255487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1997467d3105460d8c4515da9964db35, user_id=06e1ca1b34ac47108d3799e0f94d1c40, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:29.258746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:29.270794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1075/2186] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:13:29 2022] PUT /identity/v3/projects/1997467d3105460d8c4515da9964db35/users/06e1ca1b34ac47108d3799e0f94d1c40/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:13:29.281610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83d58-5533-442f-a246-15775c0a2857 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:29.281901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83d58-5533-442f-a246-15775c0a2857 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:29.282181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec83d58-5533-442f-a246-15775c0a2857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:29.310560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8ec83d58-5533-442f-a246-15775c0a2857 None None] MFA Rules not processed for user `06e1ca1b34ac47108d3799e0f94d1c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:29.311772 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8ec83d58-5533-442f-a246-15775c0a2857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:29.380442 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1112/2187] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:29.393770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:29.395498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:29.452783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa5331-e76b-4927-9757-a8b079be2a76 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:29.456634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:29.457270 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:29.457547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:29.457819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:29.466821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:29.468522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:29.477209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1076/2188] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:30.012272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0dc8c-50d3-4d14-83fa-087a6fae3c67 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:30.012766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0dc8c-50d3-4d14-83fa-087a6fae3c67 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:30.013046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0dc8c-50d3-4d14-83fa-087a6fae3c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:30.056030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-70b0dc8c-50d3-4d14-83fa-087a6fae3c67 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:30.057696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-70b0dc8c-50d3-4d14-83fa-087a6fae3c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:30.127438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:30.175382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1113/2189] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:30.262669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:30.267051 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:30.442207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdabc53-aedc-4677-bce3-d9161c362580 service glance] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:30.456455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:30.458193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:30.458193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:30.458193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:30.482589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:30.485628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:30.512879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1077/2190] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:13:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:40.137963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:40.507077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:40.894888 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189ff31-2b30-4b94-914e-3d34027d3aba None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:40.895245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189ff31-2b30-4b94-914e-3d34027d3aba None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:40.895465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189ff31-2b30-4b94-914e-3d34027d3aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:40.916457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2189ff31-2b30-4b94-914e-3d34027d3aba None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:40.918296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2189ff31-2b30-4b94-914e-3d34027d3aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:40.926085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1114/2191] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:13:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:40.938644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:40.949725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7a94c-1bf5-491e-a768-b37908b30e9f service swift] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:40.955170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:40.955844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:40.956225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:40.956570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:40.965564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:40.967211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:40.982197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1078/2192] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:13:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:41.555305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d5c3-deff-4a1a-b3da-724c1abd63de None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:41.555774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d5c3-deff-4a1a-b3da-724c1abd63de None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:41.555989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d5c3-deff-4a1a-b3da-724c1abd63de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:41.576909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5ce6d5c3-deff-4a1a-b3da-724c1abd63de None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:41.578121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ce6d5c3-deff-4a1a-b3da-724c1abd63de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:41.585345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1115/2193] 10.222.0.20 () {58 vars in 967 bytes} [Mon Oct 17 03:13:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:41.598777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:41.609936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fb5dc-6e58-4cad-95a3-c0fb3220e58b service swift] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:41.615451 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:41.616122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:41.616455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:41.616728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:41.626363 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:41.628071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:41.636575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1079/2194] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:13:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:41.796209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852b722-acbe-4677-b489-a389129889d3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:41.796496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852b722-acbe-4677-b489-a389129889d3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:41.796828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852b722-acbe-4677-b489-a389129889d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:41.823377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8852b722-acbe-4677-b489-a389129889d3 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:41.824897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8852b722-acbe-4677-b489-a389129889d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:41.836026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1116/2195] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:13:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:41.849911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:41.868322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74e018-bb51-4705-bee7-9b9cd29fc09a service swift] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:41.874712 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9dfd5-06dc-47bd-a7f0-0a8d3e2229ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:41.875633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dfd5-06dc-47bd-a7f0-0a8d3e2229ac service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:41.876213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dfd5-06dc-47bd-a7f0-0a8d3e2229ac service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:41.876910 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9dfd5-06dc-47bd-a7f0-0a8d3e2229ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:41.892926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dfd5-06dc-47bd-a7f0-0a8d3e2229ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:41.894689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9dfd5-06dc-47bd-a7f0-0a8d3e2229ac service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:41.905453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1080/2196] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:13:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:45.283150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d01ea-2d4e-4c82-a5b7-9bbd3cc6e622 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:45.284328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d01ea-2d4e-4c82-a5b7-9bbd3cc6e622 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:45.284645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d01ea-2d4e-4c82-a5b7-9bbd3cc6e622 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:45.286630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1117/2197] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:13:45.294741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0636e-7be8-43d1-9677-0d6a5002791a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:45.295272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0636e-7be8-43d1-9677-0d6a5002791a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:45.295371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0636e-7be8-43d1-9677-0d6a5002791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:45.326662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fab0636e-7be8-43d1-9677-0d6a5002791a None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:45.328359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fab0636e-7be8-43d1-9677-0d6a5002791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:45.583026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1081/2198] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:13:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:51.816029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=9 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:55.505641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d01ea-2d4e-4c82-a5b7-9bbd3cc6e622 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:55.518273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d01ea-2d4e-4c82-a5b7-9bbd3cc6e622 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:55.522607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:55.523282 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:55.523567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:55.523841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:55.536048 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:55.537504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:55.542701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=49 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:55.550110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1118/2199] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:55.648952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71630543-de74-41c4-807d-df3c4cd8fd4a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:55.649239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71630543-de74-41c4-807d-df3c4cd8fd4a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:55.649511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71630543-de74-41c4-807d-df3c4cd8fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:55.670973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-71630543-de74-41c4-807d-df3c4cd8fd4a None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:55.672356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-71630543-de74-41c4-807d-df3c4cd8fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:55.681420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1082/2200] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:55.694783 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:55.708350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f108c-a918-4554-8df8-5188aa25f3d0 service glance] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:55.714879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc87fe3-25ef-4b5a-ae05-36dccc2384a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:55.715596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc87fe3-25ef-4b5a-ae05-36dccc2384a0 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:55.715989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc87fe3-25ef-4b5a-ae05-36dccc2384a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:55.716502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc87fe3-25ef-4b5a-ae05-36dccc2384a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:55.725808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc87fe3-25ef-4b5a-ae05-36dccc2384a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:55.727528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc87fe3-25ef-4b5a-ae05-36dccc2384a0 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:55.737993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1119/2201] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:55.918376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67751-4caf-47f2-b4e7-60049dece705 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:55.918692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67751-4caf-47f2-b4e7-60049dece705 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:55.918986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef67751-4caf-47f2-b4e7-60049dece705 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:55.920346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1083/2202] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:13:55.934140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68eb7-9f0c-4b3d-9e48-9be42dce4821 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:55.934443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68eb7-9f0c-4b3d-9e48-9be42dce4821 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:55.934700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a68eb7-9f0c-4b3d-9e48-9be42dce4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:55.957704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-37a68eb7-9f0c-4b3d-9e48-9be42dce4821 None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:55.959231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-37a68eb7-9f0c-4b3d-9e48-9be42dce4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:56.044596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1120/2203] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:13:56.056538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67751-4caf-47f2-b4e7-60049dece705 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:56.059344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8ef67751-4caf-47f2-b4e7-60049dece705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:56.074115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef67751-4caf-47f2-b4e7-60049dece705 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:56.077800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676ec918-bc53-447e-8a35-f6619a269ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:56.078499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ec918-bc53-447e-8a35-f6619a269ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:56.079421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ec918-bc53-447e-8a35-f6619a269ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:56.079421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676ec918-bc53-447e-8a35-f6619a269ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:56.088208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ec918-bc53-447e-8a35-f6619a269ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:56.090969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676ec918-bc53-447e-8a35-f6619a269ec0 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:56.115164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1084/2204] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:56.224043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6314a3-73c9-4960-a5a1-ba7ce8e90a42 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:56.224338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6314a3-73c9-4960-a5a1-ba7ce8e90a42 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:56.224618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6314a3-73c9-4960-a5a1-ba7ce8e90a42 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:56.227284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1121/2205] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:13:56.234355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:56.234715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:56.235175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:56.259680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:56.261493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:56.285028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1085/2206] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:13:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:56.297179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:56.297482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:56.297762 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:56.305436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:56.319300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e90001-3530-42c0-bd89-729e3b867f81 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:56.323754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:56.325243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:56.325757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:56.326250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:56.328648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:56.329883 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:56.340097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:56.340287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1122/2207] 10.222.0.20 () {58 vars in 967 bytes} [Mon Oct 17 03:13:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:56.342164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:56.356933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1086/2208] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:13:56.363218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:56.390077 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541095d-e87b-40d2-9a65-aa9fd6ec9023 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:56.397306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e95ba-db20-45d1-a249-0ccd1efd8ea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:56.398177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e95ba-db20-45d1-a249-0ccd1efd8ea6 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:56.399479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e95ba-db20-45d1-a249-0ccd1efd8ea6 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:56.400010 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e95ba-db20-45d1-a249-0ccd1efd8ea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:56.410238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e95ba-db20-45d1-a249-0ccd1efd8ea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:56.412353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e95ba-db20-45d1-a249-0ccd1efd8ea6 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:56.449757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1123/2209] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:13:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:13:59.013087 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:59.014512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:59.114455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cc6ca-09fd-4714-b2b3-f0038c9ce548 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:59.121825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:59.122644 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:59.122945 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:59.123388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] PATH_INFO: `/v3/users/a71e979e741e4635a754444360a7eb0e` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:59.124688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71e979e741e4635a754444360a7eb0e)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:59.126734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:59.247800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71e979e741e4635a754444360a7eb0e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:59.268589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71e979e741e4635a754444360a7eb0e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:59.269557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71e979e741e4635a754444360a7eb0e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:59.270202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71e979e741e4635a754444360a7eb0e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:59.280661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71e979e741e4635a754444360a7eb0e'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:13:59.303822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1087/2210] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:13:59 2022] DELETE /identity/v3/users/a71e979e741e4635a754444360a7eb0e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:13:59.305666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:59.306152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:59.306271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:59.339075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:13:59.340670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:59.488146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1124/2211] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:13:59.489160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:59.492266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:59.555369 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:13:59.577095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275dc95-6ab3-4fa2-99b7-02f0921845db admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:59.581775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb0e64-1796-4661-81be-e660c129abe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:59.582579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0e64-1796-4661-81be-e660c129abe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:59.582977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0e64-1796-4661-81be-e660c129abe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:59.583366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb0e64-1796-4661-81be-e660c129abe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:59.597447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb0e64-1796-4661-81be-e660c129abe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:59.599134 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb0e64-1796-4661-81be-e660c129abe3 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:13:59.612611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1088/2212] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:13:59.882624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:13:59.884246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:13:59.901560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a27a8-a1eb-47b1-af86-9bcc335dc1f0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:13:59.917751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:13:59.918413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:13:59.918690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:13:59.918962 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] PATH_INFO: `/v3/projects/6b1900ad3dec447ca2f6d78df616eb2c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:13:59.923704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1900ad3dec447ca2f6d78df616eb2c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:13:59.925667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:00.051821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1900ad3dec447ca2f6d78df616eb2c', 'request_id': 'req-d689a6a0-377e-4df0-857a-bc6399bac99e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:00.061176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1900ad3dec447ca2f6d78df616eb2c', 'request_id': 'req-d689a6a0-377e-4df0-857a-bc6399bac99e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:00.064280 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:00.070654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1900ad3dec447ca2f6d78df616eb2c', 'request_id': 'req-d689a6a0-377e-4df0-857a-bc6399bac99e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:00.088348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] The token cache is being invalidate because project 6b1900ad3dec447ca2f6d78df616eb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:14:00.089587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:00.090557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:00.092260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1125/2213] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:13:59 2022] DELETE /identity/v3/projects/6b1900ad3dec447ca2f6d78df616eb2c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:14:00.472828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64991cc-7a99-455c-a831-3ca1eeca9a70 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:00.473349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64991cc-7a99-455c-a831-3ca1eeca9a70 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:00.473444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64991cc-7a99-455c-a831-3ca1eeca9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:00.521806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f64991cc-7a99-455c-a831-3ca1eeca9a70 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:00.523309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f64991cc-7a99-455c-a831-3ca1eeca9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:00.665045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1089/2214] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:14:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:00.681616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:00.684514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:00.799198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689a6a0-377e-4df0-857a-bc6399bac99e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:00.811310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:00.812280 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:00.812785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:00.813422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:00.825601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:00.829174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:00.850828 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1126/2215] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:14:05.937897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:05.938569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:05.938569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:05.970319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:05.971812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:05.981704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1090/2216] 10.222.0.20 () {58 vars in 967 bytes} [Mon Oct 17 03:14:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:05.995620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:06.007260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf511c50-d014-4321-ae62-5b31bc4c01f1 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:06.016518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4813-78e1-4845-95a4-772b72e3167a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:06.017488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4813-78e1-4845-95a4-772b72e3167a service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:06.017964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4813-78e1-4845-95a4-772b72e3167a service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:06.018438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4813-78e1-4845-95a4-772b72e3167a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:06.028895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4813-78e1-4845-95a4-772b72e3167a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:06.033531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4813-78e1-4845-95a4-772b72e3167a service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:06.046881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1127/2217] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:14:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:14:06.833965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:06.835107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:06.931371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1820c-a421-4c26-b44a-be54f8cac4c8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:06.939234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:06.940948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:06.941406 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:06.941841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] PATH_INFO: `/v3/users/28e0ab09119d4057b55d5135f8b25204` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:06.943377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e0ab09119d4057b55d5135f8b25204)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:06.945689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:07.012143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e0ab09119d4057b55d5135f8b25204'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.019909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e0ab09119d4057b55d5135f8b25204'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.021037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e0ab09119d4057b55d5135f8b25204'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.021037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e0ab09119d4057b55d5135f8b25204'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.029977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e0ab09119d4057b55d5135f8b25204'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.045163 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:07.050273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1091/2218] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:14:06 2022] DELETE /identity/v3/users/28e0ab09119d4057b55d5135f8b25204 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:14:07.054815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:07.055822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:07.056359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:07.078825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:07.080536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:07.161575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1128/2219] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:14:07.171501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:07.173264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:07.256114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c382af-a0dd-49df-99a3-4a30ee0c4305 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:07.261242 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:07.262437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:07.263914 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:07.264267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:07.284905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:07.289516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:07.307316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1092/2220] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:07.762125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:07.767113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:07.785822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18e127-a31c-4d26-9dd3-ab58b52ac3a9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:07.795320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:07.796047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:07.796921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:07.797514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] PATH_INFO: `/v3/projects/3787be30fbad4e2099c09d3e419391cc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:07.799135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3787be30fbad4e2099c09d3e419391cc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:07.801941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:07.944793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3787be30fbad4e2099c09d3e419391cc', 'request_id': 'req-d41799cc-9e65-428e-b1a3-124a811a7fdd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.958451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3787be30fbad4e2099c09d3e419391cc', 'request_id': 'req-d41799cc-9e65-428e-b1a3-124a811a7fdd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:07.968592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:07.981037 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3787be30fbad4e2099c09d3e419391cc', 'request_id': 'req-d41799cc-9e65-428e-b1a3-124a811a7fdd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.011703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] The token cache is being invalidate because project 3787be30fbad4e2099c09d3e419391cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:14:08.012038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.014498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.017065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1129/2221] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:14:07 2022] DELETE /identity/v3/projects/3787be30fbad4e2099c09d3e419391cc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:14:08.693933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:08.696907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:08.720103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6a2b-a557-41b2-9d07-e36e20624c13 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:08.845858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:08.846549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:08.846828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:08.847102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] PATH_INFO: `/v3/users/8e8172d3194e474997f25c25892c31ac` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:08.848295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8172d3194e474997f25c25892c31ac)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:08.850225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:08.943895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8172d3194e474997f25c25892c31ac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.953815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8172d3194e474997f25c25892c31ac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.960499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8172d3194e474997f25c25892c31ac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.961362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8172d3194e474997f25c25892c31ac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:08.976175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-29d896f7-fc95-4e3b-861c-9cf349bf931b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8172d3194e474997f25c25892c31ac'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:09.006974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1093/2222] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:14:08 2022] DELETE /identity/v3/users/8e8172d3194e474997f25c25892c31ac => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:14:09.241757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.243237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:09.267035 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41799cc-9e65-428e-b1a3-124a811a7fdd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.360548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.361463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.362177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.362603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] PATH_INFO: `/v3/projects/1ed3aa1ffc4b42f7aff259a5eba7bf97` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.364154 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed3aa1ffc4b42f7aff259a5eba7bf97)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.366941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:09.427603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed3aa1ffc4b42f7aff259a5eba7bf97', 'request_id': 'req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:09.445879 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed3aa1ffc4b42f7aff259a5eba7bf97', 'request_id': 'req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:09.453295 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed3aa1ffc4b42f7aff259a5eba7bf97', 'request_id': 'req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:09.469713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] The token cache is being invalidate because project 1ed3aa1ffc4b42f7aff259a5eba7bf97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:14:09.470029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:09.470705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-6fe0e9a8-deb8-4b06-bdb1-bc15d7ba004e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:09.472320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1130/2223] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:14:09 2022] DELETE /identity/v3/projects/1ed3aa1ffc4b42f7aff259a5eba7bf97 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:14:09.478623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.478981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.479329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.502840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:09.504229 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:09.527659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:09.586589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1094/2224] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:09.595794 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.596141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.596440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.621905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:09.623056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:09.631438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1131/2225] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:09.636262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.647024 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c567d-50ad-43c6-8a88-c1893665ff3a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.653007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.653713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.653996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.654338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.655078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:14:09.655381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.657709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:09.671761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1095/2226] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:14:09.676349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.685773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da9afe-ad0c-49fb-84ea-c25efd5036cc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.690578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.691206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.691481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.691759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.692615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.694535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:09.725482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1132/2227] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:14:09 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:14:09.729930 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.740962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64f386-0bc9-4a8f-910c-70d53c7ed44a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.812040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.812661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.812946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.813224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.813886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.815831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:09.844584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1096/2228] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:14:09 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:14:09.845760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.858240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa2fae-e878-4a98-98de-97c36c3b471f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.872262 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.873015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.873405 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.873672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.874342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.876140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:09.895906 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1133/2229] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:14:09.898867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.910018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de8d33-41eb-4af9-9370-0c7a376c97a3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.915093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aad0b0-cacf-46b2-9c52-a577e7c102f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.915714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad0b0-cacf-46b2-9c52-a577e7c102f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.916079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad0b0-cacf-46b2-9c52-a577e7c102f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.916357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad0b0-cacf-46b2-9c52-a577e7c102f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.917065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad0b0-cacf-46b2-9c52-a577e7c102f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.918888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad0b0-cacf-46b2-9c52-a577e7c102f1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:09.934676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1097/2230] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:14:09.936055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:09.960299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e341-0096-47f3-9858-2bf941edab24 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:09.965072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:09.965739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:09.966020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:09.966294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] PATH_INFO: `/v3/projects/e87d07b49e174e3db34ba890eaaa167f/users/f8a67dbcaa5a408e902f741e4449ec1f/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:09.983156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87d07b49e174e3db34ba890eaaa167f, user_id=f8a67dbcaa5a408e902f741e4449ec1f, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:09.985867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:10.000784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1134/2231] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:14:09 2022] PUT /identity/v3/projects/e87d07b49e174e3db34ba890eaaa167f/users/f8a67dbcaa5a408e902f741e4449ec1f/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:14:10.006040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:10.006429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:10.006777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:10.026866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:10.028114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:10.098288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:10.100208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:10.100350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1098/2232] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:10.110421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:10.112086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:10.114449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce19cca-3dad-4b4a-af9b-9faa1d52c435 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:10.119151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:10.120341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:10.120650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:10.121049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] PATH_INFO: `/v3/users/06e1ca1b34ac47108d3799e0f94d1c40` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:10.122201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e1ca1b34ac47108d3799e0f94d1c40)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:10.124208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:10.131013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:10.145020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:10.174685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3ec33-24e5-4936-9868-eb31c26948d4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:10.178132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e1ca1b34ac47108d3799e0f94d1c40'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:10.178402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80732ce9-78e7-433f-ade8-ca2153bfbcf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:10.179011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732ce9-78e7-433f-ade8-ca2153bfbcf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:10.179295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732ce9-78e7-433f-ade8-ca2153bfbcf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:10.179570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80732ce9-78e7-433f-ade8-ca2153bfbcf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:10.186041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e1ca1b34ac47108d3799e0f94d1c40'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:10.186817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e1ca1b34ac47108d3799e0f94d1c40'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:10.187503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e1ca1b34ac47108d3799e0f94d1c40'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:10.189274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732ce9-78e7-433f-ade8-ca2153bfbcf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:10.192101 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80732ce9-78e7-433f-ade8-ca2153bfbcf1 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:10.195223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e1ca1b34ac47108d3799e0f94d1c40'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:10.207474 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1099/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:14:10.214764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1135/2234] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:14:10 2022] DELETE /identity/v3/users/06e1ca1b34ac47108d3799e0f94d1c40 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:14:10.219706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:10.220253 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:10.220541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:10.245066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:10.246631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:10.315864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1100/2235] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:10.328932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:10.330502 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:10.397552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdc240-0653-4be4-b286-49799c7f9708 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:10.402517 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b17b-9c4a-48a6-acad-b4f8271ede81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:10.403140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b17b-9c4a-48a6-acad-b4f8271ede81 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:10.403419 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b17b-9c4a-48a6-acad-b4f8271ede81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:10.403694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b17b-9c4a-48a6-acad-b4f8271ede81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:10.416371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b17b-9c4a-48a6-acad-b4f8271ede81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:10.418206 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b17b-9c4a-48a6-acad-b4f8271ede81 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:10.433465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1136/2236] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:11.030425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.032698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.055988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682f008-22c8-4d54-a1c0-34b81b96c0ff None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.062137 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.062954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.063237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.063507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] PATH_INFO: `/v3/projects/1997467d3105460d8c4515da9964db35` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.064675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1997467d3105460d8c4515da9964db35)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.066586 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.119709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1997467d3105460d8c4515da9964db35', 'request_id': 'req-47a42815-53a8-4b8e-a8f4-4cf06488c011'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:11.129696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1997467d3105460d8c4515da9964db35', 'request_id': 'req-47a42815-53a8-4b8e-a8f4-4cf06488c011'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:11.136907 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1997467d3105460d8c4515da9964db35', 'request_id': 'req-47a42815-53a8-4b8e-a8f4-4cf06488c011'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:11.149095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] The token cache is being invalidate because project 1997467d3105460d8c4515da9964db35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:14:11.149095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:11.151111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-47a42815-53a8-4b8e-a8f4-4cf06488c011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:11.153037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1101/2237] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:14:11 2022] DELETE /identity/v3/projects/1997467d3105460d8c4515da9964db35 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:14:11.157867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a077b-b34b-4e94-a2eb-2e420be68d79 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.158151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a077b-b34b-4e94-a2eb-2e420be68d79 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.158424 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a077b-b34b-4e94-a2eb-2e420be68d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.179112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6e4a077b-b34b-4e94-a2eb-2e420be68d79 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:11.180676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e4a077b-b34b-4e94-a2eb-2e420be68d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.254901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1137/2238] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:11.262896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.263593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.264117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.290476 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:11.292220 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.294674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.295376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.295376 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.306095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1102/2239] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:11.310167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.329081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f441d-ea85-4f16-b7b9-b5813b9efe17 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.335784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.336468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.336755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.337514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.337677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:14:11.338535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.340171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.341881 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] MFA Rules not processed for user `f8a67dbcaa5a408e902f741e4449ec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:11.343807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.354773 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1103/2240] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:14:11.359000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.364142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:11.372165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edd6f6-0adb-4d66-baba-a3c484419cb1 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.377790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.378400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.378686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.378960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.379600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.381578 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.415305 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1104/2241] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:14:11 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:14:11.416956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.430884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:11.433955 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1138/2242] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:11.445560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.446981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.490215 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f173f-abdd-4c22-8d1d-b44d1658695c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.496216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.496893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.497214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.497545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.498192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.500339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.517108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851f34-41b8-47f4-83d3-06b4f4fbb019 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.525849 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1105/2243] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:14:11 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:14:11.526978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.536556 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a146a28-2eaf-49ec-9af8-7d9dd30cbc14 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.541695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.542288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.542567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.542843 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.543513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.545205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.558923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1106/2244] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:14:11.560041 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.569728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d7607-cd1a-49aa-bc13-803c14c5046e admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.570719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.571420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.571811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.572141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.574788 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.575377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.575655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.575960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.576603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.578180 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.588695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1107/2245] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:14:11.592873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.602711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12930e3-54f0-4fae-877d-69d99bda7e9c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.608109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30a431-7aa3-4060-b394-201fbd912117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.608756 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30a431-7aa3-4060-b394-201fbd912117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.609039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30a431-7aa3-4060-b394-201fbd912117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.609313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30a431-7aa3-4060-b394-201fbd912117 admin admin] PATH_INFO: `/v3/projects/225afd63f01845a695d397637bf679f9/users/7605e450ff6c4f6096cb7a96070b2eb8/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.625365 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30a431-7aa3-4060-b394-201fbd912117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225afd63f01845a695d397637bf679f9, user_id=7605e450ff6c4f6096cb7a96070b2eb8, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.627983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30a431-7aa3-4060-b394-201fbd912117 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.632113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.633950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.641786 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1108/2246] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:14:11 2022] PUT /identity/v3/projects/225afd63f01845a695d397637bf679f9/users/7605e450ff6c4f6096cb7a96070b2eb8/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:14:11.644297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1139/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:14:11.653304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544a7d-c0e7-4713-9e2c-e1b47e26071c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.653613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544a7d-c0e7-4713-9e2c-e1b47e26071c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.653895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed544a7d-c0e7-4713-9e2c-e1b47e26071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.683810 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ed544a7d-c0e7-4713-9e2c-e1b47e26071c None None] MFA Rules not processed for user `7605e450ff6c4f6096cb7a96070b2eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:11.685066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ed544a7d-c0e7-4713-9e2c-e1b47e26071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.753144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1109/2248] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:11.764733 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:11.766126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:11.777526 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1464e-880e-4d07-af0e-924df457e47d service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:11.803601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:11.829190 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15329db-024b-49c3-a7a1-3eee7bc1ad3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:11.829800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15329db-024b-49c3-a7a1-3eee7bc1ad3c service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:11.830078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15329db-024b-49c3-a7a1-3eee7bc1ad3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:11.830347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15329db-024b-49c3-a7a1-3eee7bc1ad3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:11.839606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15329db-024b-49c3-a7a1-3eee7bc1ad3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:11.841098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15329db-024b-49c3-a7a1-3eee7bc1ad3c service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:11.850994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1140/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:13.034295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:13.034829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:13.034829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:13.053724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] MFA Rules not processed for user `f8a67dbcaa5a408e902f741e4449ec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:13.054852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:13.096173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:13.110151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1110/2250] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:19.456695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:19.457172 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:19.457266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:19.476717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:19.477947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:19.534688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1141/2251] 10.222.0.20 () {58 vars in 967 bytes} [Mon Oct 17 03:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:19.547658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:19.549089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:19.619385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470385-ad76-458f-aa91-fd0c7a238939 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:19.624402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcb48-aadb-4c97-83a1-6d9c2b5a9bb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:19.625008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcb48-aadb-4c97-83a1-6d9c2b5a9bb6 service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:19.625293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcb48-aadb-4c97-83a1-6d9c2b5a9bb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:19.625568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcb48-aadb-4c97-83a1-6d9c2b5a9bb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:19.633592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcb48-aadb-4c97-83a1-6d9c2b5a9bb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:19.635249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcb48-aadb-4c97-83a1-6d9c2b5a9bb6 service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:19.643140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1111/2252] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:14:22.318808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:22.387231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee201f8d-940b-4f9e-8c5e-0a4403beeb9e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:22.392727 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:22.393378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:22.394179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:22.394472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] PATH_INFO: `/v3/users/7605e450ff6c4f6096cb7a96070b2eb8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:22.396223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7605e450ff6c4f6096cb7a96070b2eb8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:22.397773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:22.451135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7605e450ff6c4f6096cb7a96070b2eb8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:22.458163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7605e450ff6c4f6096cb7a96070b2eb8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:22.458885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7605e450ff6c4f6096cb7a96070b2eb8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:22.459488 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7605e450ff6c4f6096cb7a96070b2eb8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:22.467152 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7605e450ff6c4f6096cb7a96070b2eb8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:22.480345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:22.489416 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1142/2253] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:14:22 2022] DELETE /identity/v3/users/7605e450ff6c4f6096cb7a96070b2eb8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:14:22.495068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254f33-159f-4134-a614-69be7e570581 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:22.495570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254f33-159f-4134-a614-69be7e570581 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:22.495682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254f33-159f-4134-a614-69be7e570581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:22.518093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8b254f33-159f-4134-a614-69be7e570581 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:22.518093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8b254f33-159f-4134-a614-69be7e570581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:22.584949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1112/2254] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:22.596101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:22.597730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:22.660609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb8654-cb6f-4ffc-bc42-b67ac2ece7b5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:22.664373 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b1415-9f47-47c6-9c92-0220e43bf494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:22.664985 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b1415-9f47-47c6-9c92-0220e43bf494 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:22.665818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b1415-9f47-47c6-9c92-0220e43bf494 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:22.666075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b1415-9f47-47c6-9c92-0220e43bf494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:22.675185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b1415-9f47-47c6-9c92-0220e43bf494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:22.676650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b1415-9f47-47c6-9c92-0220e43bf494 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:22.687061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1143/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:14:22.953771 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b254f33-159f-4134-a614-69be7e570581 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:22.962637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8b254f33-159f-4134-a614-69be7e570581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:22.977085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b254f33-159f-4134-a614-69be7e570581 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:22.982337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:22.982911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:22.983195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:22.983534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] PATH_INFO: `/v3/projects/225afd63f01845a695d397637bf679f9` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:22.984690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225afd63f01845a695d397637bf679f9)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:22.986838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:23.031995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225afd63f01845a695d397637bf679f9', 'request_id': 'req-893b533a-0abb-4e95-875b-56990e06b7c5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:23.039318 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225afd63f01845a695d397637bf679f9', 'request_id': 'req-893b533a-0abb-4e95-875b-56990e06b7c5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:23.046284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225afd63f01845a695d397637bf679f9', 'request_id': 'req-893b533a-0abb-4e95-875b-56990e06b7c5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:23.056397 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] The token cache is being invalidate because project 225afd63f01845a695d397637bf679f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:14:23.056687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:23.057312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-893b533a-0abb-4e95-875b-56990e06b7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:14:23.058764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1113/2256] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:14:22 2022] DELETE /identity/v3/projects/225afd63f01845a695d397637bf679f9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:14:32.683146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=28 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:33.053408 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:14:36.332770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:36.333413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:36.333413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:36.351844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] MFA Rules not processed for user `1f4cfde8f1cd4c8bb071ae174fba8b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:36.353588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:36.409660 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1144/2257] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:14:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:44.048750 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b588d2a-db00-41c4-a709-7a6cf1659c2c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:44.049334 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b588d2a-db00-41c4-a709-7a6cf1659c2c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:44.049619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b588d2a-db00-41c4-a709-7a6cf1659c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:44.076017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6b588d2a-db00-41c4-a709-7a6cf1659c2c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:44.076017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6b588d2a-db00-41c4-a709-7a6cf1659c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:44.130614 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1114/2258] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:44.146169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:44.147575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:44.219143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47a3ec-d067-4997-966b-f93de18481ee None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:44.224720 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:44.225320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:44.225601 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:44.225869 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:44.234182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:44.235755 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:44.245352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1145/2259] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:47.110867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:47.111675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:47.111675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:47.131053 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:47.132351 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:47.140689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1115/2260] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:47.158014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:47.169004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae694-3e2f-4c7a-924e-f3a3e04d785b service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:47.174460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be4b87-a268-4063-982e-f0712365ced2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:47.175050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4b87-a268-4063-982e-f0712365ced2 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:47.175333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4b87-a268-4063-982e-f0712365ced2 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:47.175603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be4b87-a268-4063-982e-f0712365ced2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:47.183571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be4b87-a268-4063-982e-f0712365ced2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:47.185163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be4b87-a268-4063-982e-f0712365ced2 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:47.194261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1146/2261] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:50.232447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:50.234557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:50.316086 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4c1fe-6407-46b8-850d-c2225d492578 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:50.323066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:50.323697 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:50.324013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:50.324332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:50.327065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:50.344212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:50.346020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:50.357944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1116/2262] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:51.445603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c929b-d20e-4b5f-ab60-54c84c4ba45d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:51.446141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c929b-d20e-4b5f-ab60-54c84c4ba45d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:51.446141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c929b-d20e-4b5f-ab60-54c84c4ba45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:51.465787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cf0c929b-d20e-4b5f-ab60-54c84c4ba45d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:51.466977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cf0c929b-d20e-4b5f-ab60-54c84c4ba45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:51.474785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1147/2263] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:14:51.490549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:51.492105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:51.506732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96934a-859b-4b55-99ac-4b2b66a5adb4 service placement] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:51.512655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:51.513244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:51.513527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:51.513800 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:51.521766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:51.523895 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:51.533166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1117/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:54.480297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3ced-40d4-444a-a25e-9a5c0fb2f136 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:54.480761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3ced-40d4-444a-a25e-9a5c0fb2f136 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:54.480884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a3ced-40d4-444a-a25e-9a5c0fb2f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:54.501568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f17a3ced-40d4-444a-a25e-9a5c0fb2f136 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:54.502758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f17a3ced-40d4-444a-a25e-9a5c0fb2f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:54.511064 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1148/2265] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:54.537227 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:54.548293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129df13e-7841-4768-8094-f8797b64f551 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:54.553577 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:54.554156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:54.554430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:54.554700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:54.562826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:54.564534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:54.574339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1118/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:14:57.655696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60289-23b7-4270-b0fc-5f1eb8d18148 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:57.656188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60289-23b7-4270-b0fc-5f1eb8d18148 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:57.656299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60289-23b7-4270-b0fc-5f1eb8d18148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:57.675296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-99b60289-23b7-4270-b0fc-5f1eb8d18148 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:14:57.676577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-99b60289-23b7-4270-b0fc-5f1eb8d18148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:14:57.684327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1149/2267] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:14:57.702511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:14:57.714593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824576-2f0a-4503-b540-0609c0ab5ad6 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:14:57.720057 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:14:57.720646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:14:57.720924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:14:57.721197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:14:57.729272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:14:57.730822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:14:57.740315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1119/2268] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:00.823060 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0020-55d7-4d61-9d3a-bf61721b82a8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:00.823473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0020-55d7-4d61-9d3a-bf61721b82a8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:00.823697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a0020-55d7-4d61-9d3a-bf61721b82a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:00.842669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-808a0020-55d7-4d61-9d3a-bf61721b82a8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:00.843856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-808a0020-55d7-4d61-9d3a-bf61721b82a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:00.851623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1150/2269] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:00.875405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:15:00.887516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba41f91-9922-42a3-90a1-031032395f12 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:15:00.893054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd528b-ab65-42c2-a06c-5aefdf2b371e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:15:00.893678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd528b-ab65-42c2-a06c-5aefdf2b371e service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:00.893979 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd528b-ab65-42c2-a06c-5aefdf2b371e service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:00.894255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd528b-ab65-42c2-a06c-5aefdf2b371e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:00.902400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd528b-ab65-42c2-a06c-5aefdf2b371e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:15:00.903982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd528b-ab65-42c2-a06c-5aefdf2b371e service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:15:00.913233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1120/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:10.837728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=77 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:10.909028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:17.194377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc06ee-720f-4331-8b43-fd4af0745b79 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:17.194886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc06ee-720f-4331-8b43-fd4af0745b79 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:17.195001 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc06ee-720f-4331-8b43-fd4af0745b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:17.213767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5cfc06ee-720f-4331-8b43-fd4af0745b79 None None] MFA Rules not processed for user `f8a67dbcaa5a408e902f741e4449ec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:17.214973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5cfc06ee-720f-4331-8b43-fd4af0745b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:17.270498 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1151/2271] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:18.169695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:18.170173 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:18.170291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:18.190217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] MFA Rules not processed for user `286158259165419f818b43de5a69dd74`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:18.191709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:18.257199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1121/2272] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:15:27.263565 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=25 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:28.245393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=25 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:15:34.324874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cc8b5-d22e-4a12-b454-085f45704c4a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:34.325375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cc8b5-d22e-4a12-b454-085f45704c4a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:34.325375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cc8b5-d22e-4a12-b454-085f45704c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:34.345006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-335cc8b5-d22e-4a12-b454-085f45704c4a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:34.346220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-335cc8b5-d22e-4a12-b454-085f45704c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:34.357081 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1152/2273] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:34.372193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:15:34.385747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c4d90-9b78-4fee-84b5-4c80490eb3b8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:15:34.392161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:15:34.392796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:34.393096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:34.393367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:34.402001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:15:34.403630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:15:34.412998 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1122/2274] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:37.559651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb940-e1f3-4b5b-9dc2-e0ed2cb8bbd5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:37.560529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb940-e1f3-4b5b-9dc2-e0ed2cb8bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:37.560810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fb940-e1f3-4b5b-9dc2-e0ed2cb8bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:37.582174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8d6fb940-e1f3-4b5b-9dc2-e0ed2cb8bbd5 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:37.583397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8d6fb940-e1f3-4b5b-9dc2-e0ed2cb8bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:37.591889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1153/2275] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:37.605896 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:15:37.617288 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903058e-6023-4848-bacd-46a3babfb269 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:15:37.622698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:15:37.623324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:37.623601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:37.623951 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:37.632438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:15:37.633996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:15:37.643893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1123/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:40.652995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364058-dee6-43f2-8d56-1f50327f6903 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:40.653518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364058-dee6-43f2-8d56-1f50327f6903 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:40.653624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364058-dee6-43f2-8d56-1f50327f6903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:40.676538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a3364058-dee6-43f2-8d56-1f50327f6903 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:40.677740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a3364058-dee6-43f2-8d56-1f50327f6903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:40.686268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1154/2277] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:40.700652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:15:40.712166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22dbe2-72ad-4628-a43c-6b80e9403bf0 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:15:40.717827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:15:40.718415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:40.718698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:40.718972 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:40.726990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:15:40.729120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:15:40.739608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1124/2278] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:43.816135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8238ea-ca1e-445b-a8c6-b05d3d9fd2ce None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:43.816618 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8238ea-ca1e-445b-a8c6-b05d3d9fd2ce None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:43.816723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8238ea-ca1e-445b-a8c6-b05d3d9fd2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:43.835511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ff8238ea-ca1e-445b-a8c6-b05d3d9fd2ce None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:43.836785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ff8238ea-ca1e-445b-a8c6-b05d3d9fd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:43.844905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1155/2279] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:43.863536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:15:43.874587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c2dee-130d-420f-91e8-f20d82089d17 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:15:43.880093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:15:43.880679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:43.880957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:43.881228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:43.889186 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:15:43.890733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:15:43.900566 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1125/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:46.969112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d425-de5a-45f0-87ec-3bdb566e4294 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:46.969582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d425-de5a-45f0-87ec-3bdb566e4294 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:46.969745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d425-de5a-45f0-87ec-3bdb566e4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:46.989890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-38e9d425-de5a-45f0-87ec-3bdb566e4294 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:46.991075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-38e9d425-de5a-45f0-87ec-3bdb566e4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:47.004392 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1156/2281] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Oct 17 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:47.019112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:15:47.031387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f31ac6-d31d-4bd8-a84c-f294ac9055d0 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:15:47.038959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:15:47.039815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:47.040876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:47.041505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:47.052670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:15:47.053717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:15:47.065692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1126/2282] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:15:51.809400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:15:51.809920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:15:51.810032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:15:51.829348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] MFA Rules not processed for user `1f4cfde8f1cd4c8bb071ae174fba8b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:15:51.830544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:15:51.837900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1157/2283] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:15:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:15:57.061541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=30 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:01.824661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=18 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:17.152706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.154228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:17.167812 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb012266-2a41-4669-bf7d-57a63f1ce88e service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.172726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.173356 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.173643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.173920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] PATH_INFO: `/v3/users/f8a67dbcaa5a408e902f741e4449ec1f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.175043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a67dbcaa5a408e902f741e4449ec1f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.177192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.223094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a67dbcaa5a408e902f741e4449ec1f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.230394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a67dbcaa5a408e902f741e4449ec1f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.231131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a67dbcaa5a408e902f741e4449ec1f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.231728 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a67dbcaa5a408e902f741e4449ec1f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.239734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d51916ed-f287-4a43-a32b-372586f6019f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a67dbcaa5a408e902f741e4449ec1f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.256826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1127/2284] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:16:17 2022] DELETE /identity/v3/users/f8a67dbcaa5a408e902f741e4449ec1f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:16:17.428359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.440785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f261e7-0e1c-42be-b421-58efae570a31 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.496031 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.496663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.496942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.497216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] PATH_INFO: `/v3/projects/e87d07b49e174e3db34ba890eaaa167f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.498320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87d07b49e174e3db34ba890eaaa167f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.500261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.545499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87d07b49e174e3db34ba890eaaa167f', 'request_id': 'req-cbd281d0-b0da-4b01-8db5-319f8ab744fc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.552760 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87d07b49e174e3db34ba890eaaa167f', 'request_id': 'req-cbd281d0-b0da-4b01-8db5-319f8ab744fc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.558893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87d07b49e174e3db34ba890eaaa167f', 'request_id': 'req-cbd281d0-b0da-4b01-8db5-319f8ab744fc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.568845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] The token cache is being invalidate because project e87d07b49e174e3db34ba890eaaa167f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:16:17.569135 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.570333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cbd281d0-b0da-4b01-8db5-319f8ab744fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:16:17.571884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1158/2285] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:16:17 2022] DELETE /identity/v3/projects/e87d07b49e174e3db34ba890eaaa167f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:16:17.577056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.577343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.577617 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.597341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:17.598532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:17.659426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1128/2286] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:17.666412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.666702 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.666979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.687093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:17.688345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:17.698281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1159/2287] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:17.701074 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.711840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871ea73-95af-4b2c-a171-47b5048642c1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.716425 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.717031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.717304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.717579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.718223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:16:17.718523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.720154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.735117 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1129/2288] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:16:17.736208 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.745431 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f2b2d-99ee-49c1-b38f-eb03f9cc230f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.750075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.750673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.750951 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.751224 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.751861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.753788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.782648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1160/2289] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:16:17 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:16:17.786669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.797184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae68310-ab9b-462f-ad8a-f4c779465a10 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.851920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.852445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.852722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.852990 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.853616 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.855496 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.863593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:17.881802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1130/2290] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:16:17 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:16:17.883559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.893633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd888dc-bca4-4699-ad3e-98fd58efbdc7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.898732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.899317 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.899592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.899861 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.900513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.902078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.911708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1161/2291] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:16:17.915484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.925399 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a790e-a8ff-4ad7-a5f2-4b3b1765b203 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.929938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111c9ec-ab01-4e3a-87ea-48b78e33c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.930525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c9ec-ab01-4e3a-87ea-48b78e33c729 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.930805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c9ec-ab01-4e3a-87ea-48b78e33c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.931076 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111c9ec-ab01-4e3a-87ea-48b78e33c729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.931705 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111c9ec-ab01-4e3a-87ea-48b78e33c729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.933323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111c9ec-ab01-4e3a-87ea-48b78e33c729 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.943686 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1131/2292] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:16:17.948201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:17.958006 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff19d5-aea7-41e3-b626-4b6945a11b3e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:17.963572 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:17.964249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:17.964541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:17.964796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] PATH_INFO: `/v3/projects/e3b5bf8ded0942a8abe815da6580e5e9/users/95292dfda76b415fbb9a315cffbe5111/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:17.979080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b5bf8ded0942a8abe815da6580e5e9, user_id=95292dfda76b415fbb9a315cffbe5111, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:17.981747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:17.995315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1162/2293] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:16:17 2022] PUT /identity/v3/projects/e3b5bf8ded0942a8abe815da6580e5e9/users/95292dfda76b415fbb9a315cffbe5111/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:16:18.000314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4741f6-6b9b-4e05-b3a7-b5ea5071d46e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:18.000600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4741f6-6b9b-4e05-b3a7-b5ea5071d46e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:18.000872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4741f6-6b9b-4e05-b3a7-b5ea5071d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:18.020347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cb4741f6-6b9b-4e05-b3a7-b5ea5071d46e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:18.021522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cb4741f6-6b9b-4e05-b3a7-b5ea5071d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:18.078478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1132/2294] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:18.088102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:18.089770 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:18.119897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:18.147043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2639e02-c034-454a-bf6b-89d020a07fbc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:18.150717 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:18.151310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:18.151590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:18.151859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:18.160630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:18.162034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:18.171585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1163/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:22.481200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.481682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.481780 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.512968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] MFA Rules not processed for user `95292dfda76b415fbb9a315cffbe5111`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:22.514188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:22.580841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1133/2296] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:16:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:22.585684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:22.595556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755844b-178a-4f1d-89ae-723366764acd service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:22.600533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:22.601194 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.601472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.601743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.602364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:22.604380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:22.636205 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1164/2297] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:16:22 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:16:22.637714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:22.648711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc779ad-1988-45c8-8970-c60327d3aa40 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:22.709894 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:22.710726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.711088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.711436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.712348 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:22.714520 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:22.733776 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:22.744082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1134/2298] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:16:22 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:16:22.747497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:22.759414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3594780-0ebb-49ee-9acc-f42883330a25 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:22.764341 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:22.765022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.765968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.765968 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.766387 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:22.768087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:22.780040 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1165/2299] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:16:22.782983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:22.793298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91421a-8a8a-4fcb-a0ea-a50dd9263559 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:22.797926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:22.799030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.799030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.799252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] PATH_INFO: `/v3/projects/3ce824c56a07475f9122f635a463097e/users/7e0f5e46073b4498826bcdad421d02dc/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.814816 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce824c56a07475f9122f635a463097e, user_id=7e0f5e46073b4498826bcdad421d02dc, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:22.817636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:22.831331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1135/2300] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:16:22 2022] PUT /identity/v3/projects/3ce824c56a07475f9122f635a463097e/users/7e0f5e46073b4498826bcdad421d02dc/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:16:22.835277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:22.845583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4eadd-8308-4ff4-9f63-cf5b4a4ce1e2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:22.911687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44055d38-dc34-405c-9c1e-88b15477d1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:22.912491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44055d38-dc34-405c-9c1e-88b15477d1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.912855 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44055d38-dc34-405c-9c1e-88b15477d1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.913784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44055d38-dc34-405c-9c1e-88b15477d1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.914490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44055d38-dc34-405c-9c1e-88b15477d1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:22.916179 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44055d38-dc34-405c-9c1e-88b15477d1dd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:22.926337 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1166/2301] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:16:22.931367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:22.942901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee45c0-4da8-4bc3-ae82-85aa12a36397 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:22.951785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66774-d4bb-4122-9f66-d442062be16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:22.952714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66774-d4bb-4122-9f66-d442062be16a admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:22.953197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66774-d4bb-4122-9f66-d442062be16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:22.953743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66774-d4bb-4122-9f66-d442062be16a admin admin] PATH_INFO: `/v3/projects/3ce824c56a07475f9122f635a463097e/users/7e0f5e46073b4498826bcdad421d02dc/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:22.955828 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed66774-d4bb-4122-9f66-d442062be16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce824c56a07475f9122f635a463097e, user_id=7e0f5e46073b4498826bcdad421d02dc, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:22.958624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed66774-d4bb-4122-9f66-d442062be16a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:22.970352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1136/2302] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:16:22 2022] PUT /identity/v3/projects/3ce824c56a07475f9122f635a463097e/users/7e0f5e46073b4498826bcdad421d02dc/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:16:27.764047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:27.764477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:27.764656 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:27.776092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:27.776568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:27.776723 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:27.802332 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:27.807267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:27.821575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] MFA Rules not processed for user `7e0f5e46073b4498826bcdad421d02dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:27.822842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:27.897714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1137/2303] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:16:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:16:27.929988 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1167/2304] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:16:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:27.944700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:27.946813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:27.979948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:27.981396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:28.010448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:28.055491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9160e14-4efa-4af3-aaa4-3c21be759c7d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:28.075541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:28.076200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:28.076480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:28.076753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:28.088149 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf8fcc-9579-4b95-a3e1-6ee278bc00c8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:28.095142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d74e0-a2b5-4116-8ae0-47d5f5081460 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:28.095907 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d74e0-a2b5-4116-8ae0-47d5f5081460 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:28.096255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d74e0-a2b5-4116-8ae0-47d5f5081460 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:28.096535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d74e0-a2b5-4116-8ae0-47d5f5081460 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:28.106367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d74e0-a2b5-4116-8ae0-47d5f5081460 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:28.107822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d74e0-a2b5-4116-8ae0-47d5f5081460 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:28.119936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1168/2305] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:16:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 17 03:16:28.157512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:28.159126 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:28.184296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1138/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:29.621228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5280c2-b0b2-40d5-9596-aa0f16ddff81 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:29.622123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5280c2-b0b2-40d5-9596-aa0f16ddff81 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:29.622599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5280c2-b0b2-40d5-9596-aa0f16ddff81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:29.651858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cb5280c2-b0b2-40d5-9596-aa0f16ddff81 None None] MFA Rules not processed for user `95292dfda76b415fbb9a315cffbe5111`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:29.653347 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cb5280c2-b0b2-40d5-9596-aa0f16ddff81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:29.661391 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1169/2307] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:16:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:38.168271 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:39.640650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=27 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:16:42.747465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:42.748903 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:42.805681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcc3da-456c-42c6-b125-bd7dbe05a09c service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:42.809330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:42.809918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:42.810194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:42.810489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:42.812301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:42.826831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:42.828439 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723aba0-5f72-42ec-8b7c-d58aeb8aab46 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:42.841468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1139/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:43.320667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fe68-b267-4e6c-a492-342eb78eb73b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.321254 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fe68-b267-4e6c-a492-342eb78eb73b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.321368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3fe68-b267-4e6c-a492-342eb78eb73b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.322784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1170/2309] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:16:43.329036 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260a02-192b-4805-97b7-75588b946a70 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.329329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260a02-192b-4805-97b7-75588b946a70 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.329634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f260a02-192b-4805-97b7-75588b946a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.349576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1f260a02-192b-4805-97b7-75588b946a70 None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:43.350789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1f260a02-192b-4805-97b7-75588b946a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:43.360688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1140/2310] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:16:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:43.372984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3fe68-b267-4e6c-a492-342eb78eb73b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:43.374800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9e3fe68-b267-4e6c-a492-342eb78eb73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:43.435299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3fe68-b267-4e6c-a492-342eb78eb73b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:43.439425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e462b7-aaae-4190-8be2-9b5a69ac4d3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:43.440125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e462b7-aaae-4190-8be2-9b5a69ac4d3c service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.440503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e462b7-aaae-4190-8be2-9b5a69ac4d3c service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.440773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e462b7-aaae-4190-8be2-9b5a69ac4d3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.453595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e462b7-aaae-4190-8be2-9b5a69ac4d3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:43.455131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e462b7-aaae-4190-8be2-9b5a69ac4d3c service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:43.466346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1171/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:43.534150 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdf7ea-4cdf-4c94-a697-30327c1972fd None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.534436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdf7ea-4cdf-4c94-a697-30327c1972fd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.534713 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdf7ea-4cdf-4c94-a697-30327c1972fd None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.536097 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1141/2312] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:16:43.540599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c420cf-7147-4354-a235-2507445c1a6b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.540889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c420cf-7147-4354-a235-2507445c1a6b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.541163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c420cf-7147-4354-a235-2507445c1a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.562253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c2c420cf-7147-4354-a235-2507445c1a6b None None] MFA Rules not processed for user `315ab129549044d2bce148bb55dc63ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:43.563452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c2c420cf-7147-4354-a235-2507445c1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:43.614095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1172/2313] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:16:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:43.626378 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdf7ea-4cdf-4c94-a697-30327c1972fd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:43.637823 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdf7ea-4cdf-4c94-a697-30327c1972fd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:43.641361 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fad23-1cc6-4cc2-a750-dad4673cbabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:43.641949 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fad23-1cc6-4cc2-a750-dad4673cbabf service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.642236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fad23-1cc6-4cc2-a750-dad4673cbabf service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.642503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fad23-1cc6-4cc2-a750-dad4673cbabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.649377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fad23-1cc6-4cc2-a750-dad4673cbabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:43.650783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fad23-1cc6-4cc2-a750-dad4673cbabf service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:43.658403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1142/2314] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:43.740587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89982-18b8-4b72-977d-1c13ad5743b8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.740877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89982-18b8-4b72-977d-1c13ad5743b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.741151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89982-18b8-4b72-977d-1c13ad5743b8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.742501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1173/2315] 10.222.0.20 () {54 vars in 921 bytes} [Mon Oct 17 03:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 17 03:16:43.747826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.748284 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.748394 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.768205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] MFA Rules not processed for user `b7b1497b5e4e4f77a92eba0c3d3b1cac`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:43.769405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:43.778755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1143/2316] 10.222.0.20 () {58 vars in 1018 bytes} [Mon Oct 17 03:16:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:43.788942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89982-18b8-4b72-977d-1c13ad5743b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:43.800196 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89982-18b8-4b72-977d-1c13ad5743b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:43.804589 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374bad81-e5e8-4264-93e5-87f3503e7d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:43.805167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bad81-e5e8-4264-93e5-87f3503e7d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:43.805443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bad81-e5e8-4264-93e5-87f3503e7d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:43.805709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374bad81-e5e8-4264-93e5-87f3503e7d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:43.815467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bad81-e5e8-4264-93e5-87f3503e7d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:43.816905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374bad81-e5e8-4264-93e5-87f3503e7d98 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:43.827710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1174/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:44.115511 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:44.125080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347fb2e-12be-40c6-86a3-57cc8565b43e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:44.128759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:44.129400 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:44.129679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:44.129952 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:44.132243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:44.145965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:44.147539 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:44.160017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1144/2318] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:46.732104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:46.734166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:46.735114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:46.765746 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:16:46.768137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:46.776355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1175/2319] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:16:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:16:46.789258 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:46.803512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b38f3-490a-44e6-84d9-4b3f280a3d76 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:46.815039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445804c-db64-4cae-a4b9-41301a79f1c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:46.815764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445804c-db64-4cae-a4b9-41301a79f1c9 service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:46.816184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445804c-db64-4cae-a4b9-41301a79f1c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:46.816563 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445804c-db64-4cae-a4b9-41301a79f1c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:46.827968 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445804c-db64-4cae-a4b9-41301a79f1c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:46.829700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445804c-db64-4cae-a4b9-41301a79f1c9 service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:46.839321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1145/2320] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:16:54.295557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:16:54.309055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac7be-2ee9-4e7f-8d05-28352552cd44 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:16:54.314552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:16:54.315201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:16:54.315439 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:16:54.315711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:16:54.319436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:16:54.385541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:16:54.387160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:16:54.397857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1176/2321] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:16:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:16:56.835395 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=50 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:01.604489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:01.605105 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:01.605199 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:01.626245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:01.627484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:01.634775 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1146/2322] 10.222.0.20 () {58 vars in 967 bytes} [Mon Oct 17 03:17:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:01.649654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:01.662592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606e72d-93d1-458d-9af9-ad02d9e373da service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:01.667943 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:01.668629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:01.668981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:01.669340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:01.678218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:01.679934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:01.695917 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1177/2323] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:17:03.566080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:03.576266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fc660-eda4-4446-98b2-c650747c2248 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:03.579924 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:03.580777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:03.581063 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:03.581340 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:03.584459 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:03.595214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:03.596753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:03.605347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1147/2324] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:04.755436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:04.755436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:04.776519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:04.828232 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673b1bf-f9f1-42d7-92af-18135f009b2f service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:04.832874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:04.833499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:04.833776 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:04.834043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] PATH_INFO: `/v3/users/1f4cfde8f1cd4c8bb071ae174fba8b8a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:04.835207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4cfde8f1cd4c8bb071ae174fba8b8a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:04.837171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:04.885227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4cfde8f1cd4c8bb071ae174fba8b8a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:04.892559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4cfde8f1cd4c8bb071ae174fba8b8a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:04.893676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4cfde8f1cd4c8bb071ae174fba8b8a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:04.893972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4cfde8f1cd4c8bb071ae174fba8b8a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:04.918514 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1c44cdcf-b124-4255-b011-c570fc733015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4cfde8f1cd4c8bb071ae174fba8b8a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:04.945359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1178/2325] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:17:04 2022] DELETE /identity/v3/users/1f4cfde8f1cd4c8bb071ae174fba8b8a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:17:05.137582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.155658 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae701e97-2ace-4f67-b1b2-cf864f8d0698 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.221255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.222046 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.222330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.222605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] PATH_INFO: `/v3/projects/664e6d150ab34e47acae6eaa15414bb7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.223805 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664e6d150ab34e47acae6eaa15414bb7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.225729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.271840 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664e6d150ab34e47acae6eaa15414bb7', 'request_id': 'req-553b74ff-c93e-42a8-872d-885e12cc1876'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:05.278900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664e6d150ab34e47acae6eaa15414bb7', 'request_id': 'req-553b74ff-c93e-42a8-872d-885e12cc1876'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:05.285002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664e6d150ab34e47acae6eaa15414bb7', 'request_id': 'req-553b74ff-c93e-42a8-872d-885e12cc1876'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:05.296504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] The token cache is being invalidate because project 664e6d150ab34e47acae6eaa15414bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:17:05.296841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:05.297466 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-553b74ff-c93e-42a8-872d-885e12cc1876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:05.298959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1148/2326] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:17:05 2022] DELETE /identity/v3/projects/664e6d150ab34e47acae6eaa15414bb7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:17:05.303865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.304183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.304455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.323531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:05.324736 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:05.382094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1179/2327] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:05.389690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.389965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.390246 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.412044 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:05.413263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:05.421200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1149/2328] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:05.425449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.434990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377ff0-9354-465c-aad8-b27463d1d7ea None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.439520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.440270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.440554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.440823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.441457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:17:05.441792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.443402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.454624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1180/2329] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:17:05.459236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.468233 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d61be9-d946-472f-b6d0-26756f72904f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.472829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.474038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.474321 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.474591 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.475210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.477557 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.505471 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1150/2330] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:17:05 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:17:05.509568 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.519571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305901b-9253-4a1b-bc7c-e39aab958d6c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.539581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:05.577516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.578115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.578394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.578664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.579298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.581231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.602840 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1181/2331] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:17:05 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:17:05.606994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.617864 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba257e62-ec16-4bca-88fd-25b658ebbfb8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.622722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.623328 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.623612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.623897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.624583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.626172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.636157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1151/2332] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:17:05.639937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.649756 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994e31-5651-4744-bc31-07f8691de182 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.654307 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89781d7-0d07-40f6-a492-6c2977c2443f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.654890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89781d7-0d07-40f6-a492-6c2977c2443f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.655171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89781d7-0d07-40f6-a492-6c2977c2443f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.655447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89781d7-0d07-40f6-a492-6c2977c2443f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.656113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89781d7-0d07-40f6-a492-6c2977c2443f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.657681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89781d7-0d07-40f6-a492-6c2977c2443f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.667785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1182/2333] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:17:05.671700 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.682077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d78a9d-637a-4da8-849e-656823056b77 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.686844 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.687514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.687796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.688148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] PATH_INFO: `/v3/projects/a4944bf341174702b17e861167a9ae3b/users/ea42651912164317a0c120709d17bc7f/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.702572 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4944bf341174702b17e861167a9ae3b, user_id=ea42651912164317a0c120709d17bc7f, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.705261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.719604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1152/2334] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:17:05 2022] PUT /identity/v3/projects/a4944bf341174702b17e861167a9ae3b/users/ea42651912164317a0c120709d17bc7f/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:17:05.725226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.725518 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.725793 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.744676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:05.745867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:05.804729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1183/2335] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:05.814067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:05.815725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:05.826143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:05.873404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da286-af4b-4538-bf56-a3db316ff906 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:05.877016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:05.877610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:05.877891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:05.878166 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:05.887821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:05.889298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:05.899071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1153/2336] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:06.326438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:06.336628 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb81d7-8676-4268-9db8-a6bcfde66279 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:06.340560 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:06.341174 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:06.341444 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:06.341716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:06.343474 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:06.408969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:06.410400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0e43e-9db3-4428-b18b-1a18a7d6eabd service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:06.421100 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1184/2337] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:09.683582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:09.685746 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:09.788222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee28429-155e-411a-9b3e-e1697a5a4668 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:09.794965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:09.795592 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:09.795890 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:09.796184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:09.797954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:09.810790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:09.812413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:09.825978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1154/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:11.919338 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b0c29-76e8-4623-b9e4-b5733e578cd4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:11.919822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b0c29-76e8-4623-b9e4-b5733e578cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:11.919999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b0c29-76e8-4623-b9e4-b5733e578cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:11.948778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e86b0c29-76e8-4623-b9e4-b5733e578cd4 None None] MFA Rules not processed for user `ea42651912164317a0c120709d17bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:11.949905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e86b0c29-76e8-4623-b9e4-b5733e578cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:11.976554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:12.015011 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1185/2339] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:12.029807 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:12.031300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:12.045381 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0f23-34ae-443b-8e95-60cb1a131cd4 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:12.050954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:12.051555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:12.051835 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:12.052156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:12.060210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:12.061752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:12.070304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1155/2340] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:13.344089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:13.344611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:13.344798 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:13.364238 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] MFA Rules not processed for user `ea42651912164317a0c120709d17bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:13.365704 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:13.372942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1186/2341] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:13.681797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:13.683265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:13.697651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04017c0a-f413-49b0-a3f7-2d4354e27be7 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:13.703373 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:13.704015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:13.704294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:13.704567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:13.706244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:13.726174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:13.727613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:13.742488 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1156/2342] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:14.071540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:14.073296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:14.156475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12738fcd-5290-4635-9ac6-a71331eb4ca0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:14.162120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:14.162739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:14.163030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:14.163306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:14.165107 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:14.177936 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:14.179547 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:14.190300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1187/2343] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:16.699490 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:16.717094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67399e6d-f64f-4f36-88ea-1349ee17a25f service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:16.723852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:16.724554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:16.724850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:16.725120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:16.726888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:16.740273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:16.741865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:16.752798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1157/2344] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:21.370242 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:21.383497 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f376a-6fc2-4a3f-9e4c-2a46bed82c4f service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:21.389248 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:21.390055 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:21.390388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:21.390689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:21.392491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:21.405697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:21.407436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:21.418832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1188/2345] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:26.748130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=75 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:31.414893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=56 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:43.184225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:43.194226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578848fd-79f7-49f5-9fc1-c2178ea73d91 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:43.197791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:43.198384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:43.198666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:43.198946 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:43.200665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:43.212819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:43.214224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:43.223764 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1158/2346] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:46.533321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:46.535422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:46.552226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc036-72a9-427c-aae7-93fbc2b03975 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:46.557201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:46.557807 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:46.558088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:46.558360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:46.560421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:46.572079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:46.574705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:46.586843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1189/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:46.597977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:46.599493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:46.614866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb558e-dfe4-417d-b51b-2240bd6372c2 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:46.619493 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:46.620165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:46.620447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:46.620772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] PATH_INFO: `/v3/users/286158259165419f818b43de5a69dd74` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:46.621858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=286158259165419f818b43de5a69dd74)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:46.624121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:46.671269 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '286158259165419f818b43de5a69dd74'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:46.678225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '286158259165419f818b43de5a69dd74'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:46.678893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '286158259165419f818b43de5a69dd74'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:46.679503 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '286158259165419f818b43de5a69dd74'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:46.687247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7910c194-28cd-4582-a186-e7f8afee9150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '286158259165419f818b43de5a69dd74'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:46.704936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1159/2348] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:17:46 2022] DELETE /identity/v3/users/286158259165419f818b43de5a69dd74 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:17:46.879365 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:46.890088 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e49f0-171b-413d-aa57-3e8b4d4a30c6 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:46.949831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:46.950478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:46.950763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:46.951034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] PATH_INFO: `/v3/projects/726d78c8a890424aaba00ba0b5850712` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:46.952266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726d78c8a890424aaba00ba0b5850712)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:46.954181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.002151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726d78c8a890424aaba00ba0b5850712', 'request_id': 'req-53a12515-4808-4076-90bd-5fc1d7a8f467'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:47.010017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726d78c8a890424aaba00ba0b5850712', 'request_id': 'req-53a12515-4808-4076-90bd-5fc1d7a8f467'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:47.017314 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726d78c8a890424aaba00ba0b5850712', 'request_id': 'req-53a12515-4808-4076-90bd-5fc1d7a8f467'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:47.028545 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] The token cache is being invalidate because project 726d78c8a890424aaba00ba0b5850712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:17:47.028912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:47.029758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-53a12515-4808-4076-90bd-5fc1d7a8f467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:17:47.031264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1190/2349] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:17:46 2022] DELETE /identity/v3/projects/726d78c8a890424aaba00ba0b5850712 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:17:47.036364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.036654 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.036956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.057422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:47.058634 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:47.117481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1160/2350] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:47.125352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.125635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.125905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.146220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:47.147413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:47.155086 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1191/2351] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:47.159337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.169065 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7dc3a-eeaf-46f6-ba09-e21802d7e90a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.173633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.174225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.174506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.175312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.175991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:17:47.176323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.177926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.189641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1161/2352] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:17:47.194059 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.204053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6663d-1bd0-4c72-8e30-96e5b8f3026b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.209114 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.209710 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.209992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.210265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.210934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.212889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.239899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1192/2353] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:17:47 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:17:47.243978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.254391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04217830-a61d-4bd1-b122-c838d28ef242 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.296257 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:47.310711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.311313 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.311597 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.311887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.312542 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.314467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.339550 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1162/2354] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:17:47 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:17:47.343554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.353829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84781e-7db1-4a13-84db-aa3a71271990 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.358724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.359315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.359599 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.359891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.360529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.362123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.372640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1193/2355] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:17:47.376547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.387151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0b2d9-98a6-4c6b-a632-5739edf900bb admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.391770 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c5fe-a7f6-45ce-9d28-63d990f5e032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.392387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c5fe-a7f6-45ce-9d28-63d990f5e032 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.392669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c5fe-a7f6-45ce-9d28-63d990f5e032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.392943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c5fe-a7f6-45ce-9d28-63d990f5e032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.393603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c5fe-a7f6-45ce-9d28-63d990f5e032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.395273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c5fe-a7f6-45ce-9d28-63d990f5e032 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.405593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1163/2356] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:17:47.409722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.419532 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520196c7-3e46-453f-8a93-eb8695c2ade8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.424102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.425237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.425524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.425804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] PATH_INFO: `/v3/projects/575c921790f5413997f5dc80cce28758/users/1e8fe2a7177744c8a0a45ae8c56067b6/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.439920 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575c921790f5413997f5dc80cce28758, user_id=1e8fe2a7177744c8a0a45ae8c56067b6, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.443166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.455689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1194/2357] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:17:47 2022] PUT /identity/v3/projects/575c921790f5413997f5dc80cce28758/users/1e8fe2a7177744c8a0a45ae8c56067b6/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:17:47.461001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f441c2-6084-4f73-9cef-8a9c7848b220 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.461291 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f441c2-6084-4f73-9cef-8a9c7848b220 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.461603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f441c2-6084-4f73-9cef-8a9c7848b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.480174 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-69f441c2-6084-4f73-9cef-8a9c7848b220 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:47.481371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-69f441c2-6084-4f73-9cef-8a9c7848b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:47.538862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1164/2358] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:47.548616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:47.550950 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:47.565681 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:17:47.610184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3111f-745d-42d0-8c7d-248afc8bc615 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:47.614430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:47.615026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:47.615308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:47.615581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:47.624368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:47.625786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:47.635096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1195/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:51.509098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7c04b-9bb0-411f-a16b-62616e2a31c9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:51.509628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7c04b-9bb0-411f-a16b-62616e2a31c9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:51.509628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7c04b-9bb0-411f-a16b-62616e2a31c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:51.539861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-35c7c04b-9bb0-411f-a16b-62616e2a31c9 None None] MFA Rules not processed for user `1e8fe2a7177744c8a0a45ae8c56067b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:51.541114 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-35c7c04b-9bb0-411f-a16b-62616e2a31c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:51.608630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1165/2360] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:17:51.623117 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:51.624687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:51.705371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237b9bc-4c3a-4121-aed8-88aaae51f84f service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:51.711093 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:51.711732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:51.712090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:51.712366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:51.721782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:51.723465 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:51.733043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1196/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:17:52.974329 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809023de-9dd6-43be-b6ce-96c2e997633e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:52.974888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809023de-9dd6-43be-b6ce-96c2e997633e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:52.974888 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809023de-9dd6-43be-b6ce-96c2e997633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:52.995020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-809023de-9dd6-43be-b6ce-96c2e997633e None None] MFA Rules not processed for user `1e8fe2a7177744c8a0a45ae8c56067b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:17:52.996845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-809023de-9dd6-43be-b6ce-96c2e997633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:53.005170 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1166/2362] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:17:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:17:53.319321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:17:53.328617 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51831819-59aa-4168-90bc-3a9555908fa3 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:17:53.332348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:17:53.332942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:17:53.333221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:17:53.333490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:17:53.335233 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:17:53.345394 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:17:53.346976 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6623a-aae2-40f7-8f00-672dbbcacdcf service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:17:53.355140 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1197/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:17:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:18:02.988956 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:03.351316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=60 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:18:05.861177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:18:05.861694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:18:05.861797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:18:05.880974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] MFA Rules not processed for user `ea42651912164317a0c120709d17bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:18:05.882177 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:18:05.935729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1167/2364] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:18:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:18:15.929185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=25 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:04.476067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0b8a-c73c-4a9a-a8e1-22f6d0f5de62 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:19:04.476655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0b8a-c73c-4a9a-a8e1-22f6d0f5de62 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:19:04.476655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f0b8a-c73c-4a9a-a8e1-22f6d0f5de62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:19:04.498676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f32f0b8a-c73c-4a9a-a8e1-22f6d0f5de62 None None] MFA Rules not processed for user `ea42651912164317a0c120709d17bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:19:04.500630 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f32f0b8a-c73c-4a9a-a8e1-22f6d0f5de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:19:04.511095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1198/2365] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:19:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:19:14.492334 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:19:54.462554 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:19:54.463985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:19:54.602256 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9b9a2-934e-474b-abf5-9ce3b27f01a5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:19:54.607506 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:19:54.608140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:19:54.608420 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:19:54.608689 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:19:54.610396 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:19:54.621529 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:19:54.623085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db3f5e-c6ff-4f8f-aa9f-687a1557f3c7 service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:19:54.632865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1168/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:19:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:20:04.628679 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=63 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:29.885124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:29.885684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:29.885684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:29.905683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] MFA Rules not processed for user `ea42651912164317a0c120709d17bc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:20:29.906788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:20:29.914810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1199/2367] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:20:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:20:31.152352 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:31.152931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:31.152931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:31.172687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] MFA Rules not processed for user `1e8fe2a7177744c8a0a45ae8c56067b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:20:31.173881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:20:31.182027 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1169/2368] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:20:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:20:39.900685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:41.167701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:50.794865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:20:50.809113 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4143f8f-53e7-42f4-8d27-59b94f74a668 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:20:50.815130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:20:50.815749 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:50.816124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:50.816343 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:50.818218 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:20:50.832163 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:20:50.834604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:20:50.846758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1200/2369] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:20:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:20:50.857452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:20:50.858966 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:20:50.910232 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ecf87-2ec1-42e3-9776-71540f3e6252 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:20:50.915973 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:20:50.916624 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:50.917040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:50.917171 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] PATH_INFO: `/v3/users/95292dfda76b415fbb9a315cffbe5111` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:50.918304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=95292dfda76b415fbb9a315cffbe5111)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:20:50.920273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:20:50.967402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95292dfda76b415fbb9a315cffbe5111'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:50.974947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95292dfda76b415fbb9a315cffbe5111'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:50.975643 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95292dfda76b415fbb9a315cffbe5111'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:50.976696 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95292dfda76b415fbb9a315cffbe5111'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:50.986962 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95292dfda76b415fbb9a315cffbe5111'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.006191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1170/2370] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:20:50 2022] DELETE /identity/v3/users/95292dfda76b415fbb9a315cffbe5111 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:20:51.192764 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:20:51.203418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf67a0-9bed-4026-a965-ea7e593ff4a9 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:20:51.268714 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:20:51.269339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:51.269616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:51.270455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] PATH_INFO: `/v3/projects/e3b5bf8ded0942a8abe815da6580e5e9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:51.271542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b5bf8ded0942a8abe815da6580e5e9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:20:51.273467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:20:51.317866 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b5bf8ded0942a8abe815da6580e5e9', 'request_id': 'req-49ad6e43-e611-4ff1-b3fa-23b86522824e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.324543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b5bf8ded0942a8abe815da6580e5e9', 'request_id': 'req-49ad6e43-e611-4ff1-b3fa-23b86522824e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.330822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b5bf8ded0942a8abe815da6580e5e9', 'request_id': 'req-49ad6e43-e611-4ff1-b3fa-23b86522824e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.341083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] The token cache is being invalidate because project e3b5bf8ded0942a8abe815da6580e5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:20:51.341371 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.342050 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.343461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1201/2371] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:20:51 2022] DELETE /identity/v3/projects/e3b5bf8ded0942a8abe815da6580e5e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:20:51.347909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:20:51.349354 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:20:51.362434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c055629-e8aa-4a0c-ac3c-3f9e1af943bd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:20:51.418156 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:20:51.418715 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:51.418996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:51.419273 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] PATH_INFO: `/v3/users/7e0f5e46073b4498826bcdad421d02dc` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:51.420428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0f5e46073b4498826bcdad421d02dc)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:20:51.422333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:20:51.465779 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:51.467516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0f5e46073b4498826bcdad421d02dc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.475855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0f5e46073b4498826bcdad421d02dc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.476531 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0f5e46073b4498826bcdad421d02dc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.477460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0f5e46073b4498826bcdad421d02dc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.484660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0f5e46073b4498826bcdad421d02dc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.501943 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1171/2372] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:20:51 2022] DELETE /identity/v3/users/7e0f5e46073b4498826bcdad421d02dc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:20:51.674643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:20:51.676682 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:20:51.697939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad6e43-e611-4ff1-b3fa-23b86522824e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:20:51.761812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:20:51.762443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:20:51.762726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:20:51.763002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] PATH_INFO: `/v3/projects/3ce824c56a07475f9122f635a463097e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:20:51.764142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce824c56a07475f9122f635a463097e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:20:51.766051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:20:51.786987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:20:51.812960 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce824c56a07475f9122f635a463097e', 'request_id': 'req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.820056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce824c56a07475f9122f635a463097e', 'request_id': 'req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.826165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce824c56a07475f9122f635a463097e', 'request_id': 'req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.836453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] The token cache is being invalidate because project 3ce824c56a07475f9122f635a463097e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:20:51.836732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.837369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:20:51.838867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1202/2373] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:20:51 2022] DELETE /identity/v3/projects/3ce824c56a07475f9122f635a463097e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:01.498530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=13,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:01.833511 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:36.077326 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:36.078868 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:36.092829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63287-5230-47d8-8027-0bc2d257e186 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:36.175422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:36.175711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:36.176026 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:36.176302 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] PATH_INFO: `/v3/users/ea42651912164317a0c120709d17bc7f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:36.177560 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea42651912164317a0c120709d17bc7f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:36.179485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:36.232187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea42651912164317a0c120709d17bc7f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.241555 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea42651912164317a0c120709d17bc7f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.242307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea42651912164317a0c120709d17bc7f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.242893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea42651912164317a0c120709d17bc7f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.250371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-d1acf47e-2d0a-4ea0-81ba-eabd9a736474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea42651912164317a0c120709d17bc7f'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.269673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1172/2374] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:36 2022] DELETE /identity/v3/users/ea42651912164317a0c120709d17bc7f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:36.512998 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:36.514687 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:36.547102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2bf92-4a1e-4031-b93f-3ec2105079d3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:36.606005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:36.606642 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:36.606924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:36.607198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] PATH_INFO: `/v3/projects/a4944bf341174702b17e861167a9ae3b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:36.608349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4944bf341174702b17e861167a9ae3b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:36.610309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:36.657865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4944bf341174702b17e861167a9ae3b', 'request_id': 'req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.667346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4944bf341174702b17e861167a9ae3b', 'request_id': 'req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.674106 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4944bf341174702b17e861167a9ae3b', 'request_id': 'req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.685849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] The token cache is being invalidate because project a4944bf341174702b17e861167a9ae3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:36.686143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.686833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3fdd01a5-5cd0-4a6f-9bc6-33f70602f3ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:36.688469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1203/2375] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:36 2022] DELETE /identity/v3/projects/a4944bf341174702b17e861167a9ae3b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:36.693821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:36.694111 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:36.694388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:36.758651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:36.759891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:36.805941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:36.823473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1173/2376] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:36.832009 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:36.832287 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:36.832558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:36.854615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:36.855850 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:36.865570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1204/2377] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:36.869626 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:36.880201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efaeb42-cc42-418c-9648-364434b74bd3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:36.884829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:36.885424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:36.885704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:36.885974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:36.886608 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:36.886915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:36.888532 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:36.900487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1174/2378] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:21:36.904761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:36.913877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcee1bc-358f-418e-97df-ed55b6643351 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:36.918815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:36.919421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:36.919705 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:36.920020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:36.920662 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:36.922580 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:36.950661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1205/2379] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:36 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:36.954832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:36.965745 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499c619-ad29-44cf-810c-d339087b0b3f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:37.026250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:37.026853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:37.027160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:37.027429 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:37.028184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:37.030530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:37.056754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1175/2380] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:36 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:37.060527 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:37.072753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766238e-8b8e-4134-9101-7a8f6c6f77f8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:37.095897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:37.095897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:37.095897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:37.095897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:37.096482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:37.096482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:37.105377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1206/2381] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:37.109250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:37.125071 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8f1f9-55c8-4fc4-93ff-c729d9774150 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:37.134887 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cbae-a1d3-4e64-a341-6ba8de75860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:37.136447 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cbae-a1d3-4e64-a341-6ba8de75860a admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:37.136724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cbae-a1d3-4e64-a341-6ba8de75860a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:37.136992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cbae-a1d3-4e64-a341-6ba8de75860a admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:37.138310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6cbae-a1d3-4e64-a341-6ba8de75860a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:37.140191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6cbae-a1d3-4e64-a341-6ba8de75860a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:37.156670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1176/2382] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:37.161355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:37.173349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52c88-7281-44e3-acdd-7f7b0a4ab95e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:37.179015 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:37.179694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:37.180003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:37.180286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] PATH_INFO: `/v3/projects/142d621efe854e9dac45ae7565c4ec75/users/abd5cfaacfee4eeba9d6992cb0cc0563/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:37.201469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=142d621efe854e9dac45ae7565c4ec75, user_id=abd5cfaacfee4eeba9d6992cb0cc0563, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:37.205539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:37.231633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1207/2383] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:37 2022] PUT /identity/v3/projects/142d621efe854e9dac45ae7565c4ec75/users/abd5cfaacfee4eeba9d6992cb0cc0563/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:37.243341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:37.243926 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:37.244411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:37.291485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] MFA Rules not processed for user `abd5cfaacfee4eeba9d6992cb0cc0563`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:37.292994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:37.373729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1177/2384] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:37.381209 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:37.383715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:37.419279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:37.510236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d49602-75d3-4dc3-a447-fb56e78fae6e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:37.516651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:37.520566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:37.520966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:37.521204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:37.530066 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:37.531650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:37.541898 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1208/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:39.573458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:39.575008 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:39.623603 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:39.642040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c04f19-0b40-43db-907e-ebd797ce11c0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:39.646562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:39.647186 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:39.647462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:39.647732 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] PATH_INFO: `/v3/users/1e8fe2a7177744c8a0a45ae8c56067b6` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:39.648874 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8fe2a7177744c8a0a45ae8c56067b6)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:39.650778 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:39.697070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8fe2a7177744c8a0a45ae8c56067b6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:39.703813 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8fe2a7177744c8a0a45ae8c56067b6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:39.704497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8fe2a7177744c8a0a45ae8c56067b6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:39.705188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8fe2a7177744c8a0a45ae8c56067b6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:39.712388 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-32778c6c-1245-4bae-b33f-4a62dfb558ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8fe2a7177744c8a0a45ae8c56067b6'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:39.730075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1178/2386] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:39 2022] DELETE /identity/v3/users/1e8fe2a7177744c8a0a45ae8c56067b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:39.899501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:39.911370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ad75-a4c8-4fca-91ce-28c29c13670f service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:39.966987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:39.967616 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:39.967921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:39.968198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] PATH_INFO: `/v3/projects/575c921790f5413997f5dc80cce28758` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:39.969298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575c921790f5413997f5dc80cce28758)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:39.971904 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.015294 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575c921790f5413997f5dc80cce28758', 'request_id': 'req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.023078 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575c921790f5413997f5dc80cce28758', 'request_id': 'req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.029321 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575c921790f5413997f5dc80cce28758', 'request_id': 'req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.039956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] The token cache is being invalidate because project 575c921790f5413997f5dc80cce28758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:40.040243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.040856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be6f47dd-3ab6-41d3-bb3c-3dcbb0f6ccf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.042293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1209/2387] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:39 2022] DELETE /identity/v3/projects/575c921790f5413997f5dc80cce28758 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:40.047196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.047486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.047761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.067737 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:40.068982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.128037 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1179/2388] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:40.135820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.136126 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.136398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.155815 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:40.157018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.164735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1210/2389] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:40.168923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.178402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc2417-a8cc-4fe8-bb00-9b2dec76a3c4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.182867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.183452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.183730 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.184030 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.184661 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:40.184958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.186518 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.198252 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1180/2390] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:21:40.202415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.212171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a82fc-439d-44b6-b9c3-21965664e6fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.216763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.217385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.217697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.217972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.218591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.220537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.225933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:40.258274 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1211/2391] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:40.262565 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.273002 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d874aa-f041-46fb-8764-245d9a7047ed admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.319552 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:40.331701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.332330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.332610 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.332884 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.333536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.335414 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.357283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1181/2392] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:40.361621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.372478 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e471b-7286-401a-9f69-7e0920792358 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.377510 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.378110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.378390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.378664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.379304 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.380942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.390901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1212/2393] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:40.395390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.405209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf797f60-12f2-4a0b-a24b-e99a52c1e706 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.409766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffd9f9-c723-488c-9968-9f32cf8d0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.410346 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffd9f9-c723-488c-9968-9f32cf8d0798 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.410627 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffd9f9-c723-488c-9968-9f32cf8d0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.410898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffd9f9-c723-488c-9968-9f32cf8d0798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.411528 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffd9f9-c723-488c-9968-9f32cf8d0798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.413165 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffd9f9-c723-488c-9968-9f32cf8d0798 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.423602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1182/2394] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:40.427390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.437315 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5552d-bf42-43a3-be90-a111b5303ea1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.442523 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.443166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.443450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.443729 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] PATH_INFO: `/v3/projects/9b2aa44bca934859b963abc20f7e4958/users/a2b2c87f6c8449c99fda8763baa8ba1d/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.458989 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2aa44bca934859b963abc20f7e4958, user_id=a2b2c87f6c8449c99fda8763baa8ba1d, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.461663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.476364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1213/2395] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:40 2022] PUT /identity/v3/projects/9b2aa44bca934859b963abc20f7e4958/users/a2b2c87f6c8449c99fda8763baa8ba1d/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:40.489683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.489683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.489683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.495476 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.495663 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.518898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] MFA Rules not processed for user `a2b2c87f6c8449c99fda8763baa8ba1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:40.520274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.567310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fc997-3843-4a36-a5f8-ef93927e5262 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.577964 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.578603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.578884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.579159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] PATH_INFO: `/v3/users/abd5cfaacfee4eeba9d6992cb0cc0563` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.580353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd5cfaacfee4eeba9d6992cb0cc0563)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.582289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.585832 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1183/2396] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:40.590145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.602235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f527d1-039c-4117-b67e-12341faadddd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.608315 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.609017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.609295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.609688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.610435 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.613058 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.631809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd5cfaacfee4eeba9d6992cb0cc0563'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.639236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd5cfaacfee4eeba9d6992cb0cc0563'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.639937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd5cfaacfee4eeba9d6992cb0cc0563'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.640489 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1184/2397] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:40.640719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd5cfaacfee4eeba9d6992cb0cc0563'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.644934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.646848 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.648449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e3115e23-52a0-4180-8458-b2126018cf89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd5cfaacfee4eeba9d6992cb0cc0563'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:40.667165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1214/2398] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:40 2022] DELETE /identity/v3/users/abd5cfaacfee4eeba9d6992cb0cc0563 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:40.671892 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.672182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.672453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.691300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:40.692539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.709296 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:40.711741 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee1c6f-ddb0-443a-a7a8-ad6b09250933 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.753120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:40.754309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1215/2399] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:40.763779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.765191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:40.771662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.772324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.772602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.772898 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.773530 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.775440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.800178 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1185/2400] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:40 2022] POST /identity/v3/users => generated 306 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:40.801200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.811981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669784-451d-40c0-9217-81896fc2d730 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.816836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.817426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.817708 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.817981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.818613 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.820256 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.830742 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1186/2401] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:40.835611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.845228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceffb4b-5b23-4b3b-9780-245fe0752373 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.846941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2cb03e-14ea-41ff-b6b0-8161b0271ff0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.850885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.851209 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.851496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.851773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.851900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.852090 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.852228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.852416 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] PATH_INFO: `/v3/projects/fa000bff5eb24c9aa17a7535efb34ac7/users/ba2bee198d6b499a921892311a62baf1/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.861445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.862878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.866790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa000bff5eb24c9aa17a7535efb34ac7, user_id=ba2bee198d6b499a921892311a62baf1, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.869662 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.873433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1216/2402] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:21:40.886766 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1187/2403] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:40 2022] PUT /identity/v3/projects/fa000bff5eb24c9aa17a7535efb34ac7/users/ba2bee198d6b499a921892311a62baf1/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:40.890806 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.901277 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6e90-b47d-444f-a73c-d6b9c3f64408 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:40.967773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fb3da-3095-4153-ad5b-b7bb7ef21352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:40.968513 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fb3da-3095-4153-ad5b-b7bb7ef21352 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:40.968799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fb3da-3095-4153-ad5b-b7bb7ef21352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:40.969067 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fb3da-3095-4153-ad5b-b7bb7ef21352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:40.969706 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fb3da-3095-4153-ad5b-b7bb7ef21352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:40.971411 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fb3da-3095-4153-ad5b-b7bb7ef21352 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:40.981891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1217/2404] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:40.986211 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:40.997444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b517db-707a-4dd7-a94a-334e4eff7e83 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.002824 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.003601 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.003938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.004279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] PATH_INFO: `/v3/projects/fa000bff5eb24c9aa17a7535efb34ac7/users/ba2bee198d6b499a921892311a62baf1/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.006213 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa000bff5eb24c9aa17a7535efb34ac7, user_id=ba2bee198d6b499a921892311a62baf1, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.009307 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.026314 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1188/2405] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:40 2022] PUT /identity/v3/projects/fa000bff5eb24c9aa17a7535efb34ac7/users/ba2bee198d6b499a921892311a62baf1/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:41.036652 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.036966 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.037241 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.067236 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] MFA Rules not processed for user `ba2bee198d6b499a921892311a62baf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:41.068586 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.100369 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:41.143587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1218/2406] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:41.155994 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.157711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.163158 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.164606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.240201 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e81ccd-fe11-4ea8-95be-cbeb07047de8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.244823 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.245446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.245722 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.245995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] PATH_INFO: `/v3/projects/142d621efe854e9dac45ae7565c4ec75` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.246798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6035b4e-dd94-4582-b846-9f8054e5589a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.247108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142d621efe854e9dac45ae7565c4ec75)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.249029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.250501 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055db121-d750-4559-86c0-8fdb1b280d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.251089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055db121-d750-4559-86c0-8fdb1b280d86 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.251376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055db121-d750-4559-86c0-8fdb1b280d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.251640 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055db121-d750-4559-86c0-8fdb1b280d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.261298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055db121-d750-4559-86c0-8fdb1b280d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.262649 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055db121-d750-4559-86c0-8fdb1b280d86 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.272175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1189/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:41.297775 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142d621efe854e9dac45ae7565c4ec75', 'request_id': 'req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:41.309885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142d621efe854e9dac45ae7565c4ec75', 'request_id': 'req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:41.317235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142d621efe854e9dac45ae7565c4ec75', 'request_id': 'req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:41.327696 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] The token cache is being invalidate because project 142d621efe854e9dac45ae7565c4ec75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:41.328030 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:41.328690 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:41.330375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1219/2408] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:41 2022] DELETE /identity/v3/projects/142d621efe854e9dac45ae7565c4ec75 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:41.335304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63c9e-e82f-44a6-8edf-105673a071aa None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.335587 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63c9e-e82f-44a6-8edf-105673a071aa None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.335857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d63c9e-e82f-44a6-8edf-105673a071aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.351632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.353111 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.355472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a1d63c9e-e82f-44a6-8edf-105673a071aa None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:41.356690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a1d63c9e-e82f-44a6-8edf-105673a071aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.414723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf46ccc-e77c-4b3a-9b8f-5f910d19b659 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.419094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.419931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.420374 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.420752 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.422897 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.426068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1190/2409] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:41.433698 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.433991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.434268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.434413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:41.456130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:41.457335 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.465463 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1191/2410] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:41.469526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.474161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:41.480083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606d5c2-8eac-4fa3-940e-8e24010a15f0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.485883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.486821 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.487018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.487295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.487562 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.488234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:41.488459 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.488545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.490079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.497433 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1220/2411] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:21:41.505985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1192/2412] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:21:41.507051 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.517537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689299e-ef66-4787-a80c-1ecc45364950 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.522402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.523020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.523301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.523575 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.524239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.526110 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.552860 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1221/2413] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:41.557083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.568135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4428c-13b5-4b36-b195-a1e12ecd3cdd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.629067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.629720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.629983 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.630285 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.630919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.633191 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.655452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1193/2414] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:41.659800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.670594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fd5cd-daf4-4f14-b8c7-30d54e3b91cf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.676507 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.677102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.677380 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.677757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.678273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.679864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.691479 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1222/2415] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:41.696103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.706478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea89f-9ffe-47cd-8bb3-dc9db6308211 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.711304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3654-8431-4009-86ca-25029f3698f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.711927 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3654-8431-4009-86ca-25029f3698f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.712214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3654-8431-4009-86ca-25029f3698f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.712486 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3654-8431-4009-86ca-25029f3698f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.713123 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3654-8431-4009-86ca-25029f3698f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.714716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3654-8431-4009-86ca-25029f3698f9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.735403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1194/2416] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:41.742007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.753530 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595912a6-25de-41ca-99b3-c2f396887377 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.758240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.758959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.759308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.759650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] PATH_INFO: `/v3/projects/76b9c15bc5d54f25b881c2662bd01fc9/users/817bb24046624883b301e9d86cef745a/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.777535 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b9c15bc5d54f25b881c2662bd01fc9, user_id=817bb24046624883b301e9d86cef745a, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.780818 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:41.796848 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1223/2417] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:41 2022] PUT /identity/v3/projects/76b9c15bc5d54f25b881c2662bd01fc9/users/817bb24046624883b301e9d86cef745a/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:41.807852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.808208 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.808467 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.838073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] MFA Rules not processed for user `817bb24046624883b301e9d86cef745a`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:41.839297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:41.903748 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1195/2418] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:41.908882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:41.969700 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae6d4-8477-483e-9301-ebd59cd8052b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:41.975430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:41.976327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:41.976611 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:41.976884 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:41.977512 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:41.979426 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.005467 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1224/2419] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:41 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:42.009669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.020944 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70674312-7789-4565-ae39-2ae485b4e61c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.070338 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:42.076918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.077695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.078192 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.078646 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.079292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.081738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.103254 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1196/2420] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:42 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:42.107331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.117822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8136ab-3d77-43e0-bf5b-8f0ce92e1a3d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.122415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.123007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.123289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.123561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.124255 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.125854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.136268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1225/2421] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:42.140353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.150701 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10714d-4144-494f-ab94-513eba2a8932 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.155214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.155852 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.156161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.156432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] PATH_INFO: `/v3/projects/0b6c267a66284312aba7ae0c30fd0271/users/13ba7659f3f14dd6a0955ebcbec9b42a/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.170628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c267a66284312aba7ae0c30fd0271, user_id=13ba7659f3f14dd6a0955ebcbec9b42a, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.173344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.185886 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1197/2422] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:42 2022] PUT /identity/v3/projects/0b6c267a66284312aba7ae0c30fd0271/users/13ba7659f3f14dd6a0955ebcbec9b42a/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:42.190335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.200214 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b863b6-d536-464b-bd9f-a3c3f0508bd3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.226703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:42.258844 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c1168-9577-4b39-a5dd-226c543e546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.259446 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c1168-9577-4b39-a5dd-226c543e546d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.259725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c1168-9577-4b39-a5dd-226c543e546d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.260038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c1168-9577-4b39-a5dd-226c543e546d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.260669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c1168-9577-4b39-a5dd-226c543e546d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.262266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c1168-9577-4b39-a5dd-226c543e546d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.271990 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1226/2423] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:42.275782 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.285954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfbbc9-e747-4c05-a3ce-005d882648b4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.290497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.291131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.291407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.291676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] PATH_INFO: `/v3/projects/0b6c267a66284312aba7ae0c30fd0271/users/13ba7659f3f14dd6a0955ebcbec9b42a/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.293600 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6c267a66284312aba7ae0c30fd0271, user_id=13ba7659f3f14dd6a0955ebcbec9b42a, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.296243 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.306509 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1198/2424] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:42 2022] PUT /identity/v3/projects/0b6c267a66284312aba7ae0c30fd0271/users/13ba7659f3f14dd6a0955ebcbec9b42a/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:42.369333 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782dbb-94ad-4165-95d7-429555830231 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.369636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782dbb-94ad-4165-95d7-429555830231 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.369912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782dbb-94ad-4165-95d7-429555830231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.397726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-51782dbb-94ad-4165-95d7-429555830231 None None] MFA Rules not processed for user `13ba7659f3f14dd6a0955ebcbec9b42a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:42.398934 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-51782dbb-94ad-4165-95d7-429555830231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:42.464538 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1227/2425] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:42.477022 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.536322 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0d7ae-7074-439d-b102-cc545f745e68 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.539863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.540533 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.540815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.541085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.550421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.551853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.560991 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1199/2426] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:42.637326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51782dbb-94ad-4165-95d7-429555830231 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:42.646784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51782dbb-94ad-4165-95d7-429555830231 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:42.650334 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981526-3557-46fc-a1f0-725fb2dbda51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:42.650947 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981526-3557-46fc-a1f0-725fb2dbda51 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:42.651223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981526-3557-46fc-a1f0-725fb2dbda51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:42.651491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981526-3557-46fc-a1f0-725fb2dbda51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:42.706520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b981526-3557-46fc-a1f0-725fb2dbda51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:42.707972 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b981526-3557-46fc-a1f0-725fb2dbda51 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:42.716571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1228/2427] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:45.599821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:45.601523 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:45.669699 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf18580-2479-4e3f-bbd6-7423552a8bc3 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:45.674811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:45.675431 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:45.675704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:45.676006 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] PATH_INFO: `/v3/users/a2b2c87f6c8449c99fda8763baa8ba1d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:45.677120 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b2c87f6c8449c99fda8763baa8ba1d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:45.679005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:45.727709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b2c87f6c8449c99fda8763baa8ba1d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:45.735255 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:45.739011 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b2c87f6c8449c99fda8763baa8ba1d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:45.740897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b2c87f6c8449c99fda8763baa8ba1d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:45.741526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b2c87f6c8449c99fda8763baa8ba1d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:45.750054 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b2c87f6c8449c99fda8763baa8ba1d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:45.768761 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1200/2428] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:45 2022] DELETE /identity/v3/users/a2b2c87f6c8449c99fda8763baa8ba1d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:45.773407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:45.774021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:45.774021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:45.795428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:45.796708 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:45.842558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:45.859646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1229/2429] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:45.869310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:45.870716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:45.935738 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88554008-eb18-4788-b587-7f773dd92cd1 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:45.939455 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:45.940207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:45.940527 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:45.940797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:45.950589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:45.952045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:45.963090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1201/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:46.244922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:46.246585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:46.265778 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228996e-ce84-4302-973c-4f806cc8fc88 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:46.271136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:46.272041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:46.272443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:46.272745 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] PATH_INFO: `/v3/projects/9b2aa44bca934859b963abc20f7e4958` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:46.274039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2aa44bca934859b963abc20f7e4958)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:46.276786 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:46.331763 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2aa44bca934859b963abc20f7e4958', 'request_id': 'req-44bce173-4e31-4ea3-b4d9-ddad058abe82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.339550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2aa44bca934859b963abc20f7e4958', 'request_id': 'req-44bce173-4e31-4ea3-b4d9-ddad058abe82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.348034 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2aa44bca934859b963abc20f7e4958', 'request_id': 'req-44bce173-4e31-4ea3-b4d9-ddad058abe82'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.359979 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] The token cache is being invalidate because project 9b2aa44bca934859b963abc20f7e4958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:46.360305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.361153 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.363482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1230/2431] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:46 2022] DELETE /identity/v3/projects/9b2aa44bca934859b963abc20f7e4958 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:46.367995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:46.378433 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6be83-2bed-40cc-be59-7b98b3f6791a service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:46.440000 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:46.440633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:46.440911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:46.441182 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] PATH_INFO: `/v3/users/ba2bee198d6b499a921892311a62baf1` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:46.442279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba2bee198d6b499a921892311a62baf1)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:46.444277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:46.489977 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba2bee198d6b499a921892311a62baf1'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.496873 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba2bee198d6b499a921892311a62baf1'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.497544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba2bee198d6b499a921892311a62baf1'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.498143 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba2bee198d6b499a921892311a62baf1'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.505092 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-f2658bf1-690f-4384-9e69-4550eb80eb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba2bee198d6b499a921892311a62baf1'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.515599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:46.525331 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1202/2432] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:46 2022] DELETE /identity/v3/users/ba2bee198d6b499a921892311a62baf1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:46.790259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:46.791766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:46.805000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce173-4e31-4ea3-b4d9-ddad058abe82 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:46.868932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:46.869592 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:46.869873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:46.870148 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] PATH_INFO: `/v3/projects/fa000bff5eb24c9aa17a7535efb34ac7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:46.871284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa000bff5eb24c9aa17a7535efb34ac7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:46.873217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:46.919215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa000bff5eb24c9aa17a7535efb34ac7', 'request_id': 'req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.925912 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa000bff5eb24c9aa17a7535efb34ac7', 'request_id': 'req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.932398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa000bff5eb24c9aa17a7535efb34ac7', 'request_id': 'req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.943130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] The token cache is being invalidate because project fa000bff5eb24c9aa17a7535efb34ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:46.943420 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.944095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9a264bf8-c5d9-414a-b9f5-7a84281d8a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:46.945553 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1231/2433] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:46 2022] DELETE /identity/v3/projects/fa000bff5eb24c9aa17a7535efb34ac7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:46.950858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:46.951345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:46.951477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:46.972085 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:46.973297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:47.032157 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1203/2434] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:47.040253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.040460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.040735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.048441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:47.062436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:47.063636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:47.072229 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1232/2435] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:47.076353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.086452 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46e60-ade9-49ee-aa2e-3562eb385eb2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.090965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.091547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.091822 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.092124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.092754 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:47.093050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.094623 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.106286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1204/2436] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:21:47.110477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.119588 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ada4f-5d0d-4632-b5d6-501fb7b7e009 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.124237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.124825 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.125104 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.125375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.125993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.128412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.155192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1233/2437] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:47.159160 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.168963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942ca1e-81f0-4483-9fd0-596bbf99e1c7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.223999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.224598 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.224879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.225149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.226040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.227933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.250141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1205/2438] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:47.254817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.265345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f18aa-1740-4e97-99c4-c1f25812071d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.271079 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.271227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.271509 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.271779 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.272452 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.274069 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.287464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1234/2439] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:21:47.288986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.299909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63c652-f29a-4270-8336-940f30a339e8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.304547 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e65da-5ea7-4244-8324-ff87ed93f0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.305140 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e65da-5ea7-4244-8324-ff87ed93f0bb admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.305421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e65da-5ea7-4244-8324-ff87ed93f0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.305694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e65da-5ea7-4244-8324-ff87ed93f0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.306358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e65da-5ea7-4244-8324-ff87ed93f0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.308007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e65da-5ea7-4244-8324-ff87ed93f0bb admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.319072 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1206/2440] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:47.323329 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.336033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344cbf5-636a-4b12-9104-6c97d6ab2b99 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.345992 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.347221 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.347455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.347921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] PATH_INFO: `/v3/projects/a9c91a4faeed4162af54da7ba8fecf4e/users/1af03c649cce4319816a8302cbdbcd59/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.368500 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9c91a4faeed4162af54da7ba8fecf4e, user_id=1af03c649cce4319816a8302cbdbcd59, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.371156 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.384243 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1235/2441] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:47 2022] PUT /identity/v3/projects/a9c91a4faeed4162af54da7ba8fecf4e/users/1af03c649cce4319816a8302cbdbcd59/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:47.395280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.395568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.395838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.423158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] MFA Rules not processed for user `1af03c649cce4319816a8302cbdbcd59`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:47.425017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:47.477226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:47.497048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1207/2442] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:47.501536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.565891 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb71a7-9744-49b0-a69a-50c076a41244 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.570473 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.571072 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.571382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.571651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.572313 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.574193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.601725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1236/2443] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:47.605971 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.618695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1d334-532c-41bf-8883-24cd63dc19bd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.680711 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.681324 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.681606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.681877 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.682505 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.684440 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.705918 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1208/2444] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:47.710049 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.722555 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03123048-8fc5-438e-80c4-d1660608a79c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.727112 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.727709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.728025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.728303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.728930 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.730499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.742401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1237/2445] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:47.746581 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.757188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdf667-a31c-468d-be48-28ac56b1048b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.761880 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.762526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.762808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.763081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] PATH_INFO: `/v3/projects/f4c3400632a544c484e1abd365947c2e/users/cb536d88ecbe4c44ba4b44b658cd8efe/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.778301 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c3400632a544c484e1abd365947c2e, user_id=cb536d88ecbe4c44ba4b44b658cd8efe, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.780965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.792883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1209/2446] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:47 2022] PUT /identity/v3/projects/f4c3400632a544c484e1abd365947c2e/users/cb536d88ecbe4c44ba4b44b658cd8efe/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:47.796810 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.806577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d72ec-998a-45b6-9345-4d735ee7f2e3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.860607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844578ba-1a02-405d-8a1c-b9e8c7183fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.861159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844578ba-1a02-405d-8a1c-b9e8c7183fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.861525 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844578ba-1a02-405d-8a1c-b9e8c7183fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.861795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844578ba-1a02-405d-8a1c-b9e8c7183fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.862421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844578ba-1a02-405d-8a1c-b9e8c7183fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.864071 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844578ba-1a02-405d-8a1c-b9e8c7183fdb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.873574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1238/2447] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:47.878194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:47.888460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0224848-1706-4398-bd5f-5bc1652cd63d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:47.893484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:47.894122 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.894407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.894677 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] PATH_INFO: `/v3/projects/f4c3400632a544c484e1abd365947c2e/users/cb536d88ecbe4c44ba4b44b658cd8efe/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.896579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4c3400632a544c484e1abd365947c2e, user_id=cb536d88ecbe4c44ba4b44b658cd8efe, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:47.899154 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:47.909099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1210/2448] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:47 2022] PUT /identity/v3/projects/f4c3400632a544c484e1abd365947c2e/users/cb536d88ecbe4c44ba4b44b658cd8efe/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:47.918905 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:47.919197 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:47.919470 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:47.938753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:47.948902 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] MFA Rules not processed for user `cb536d88ecbe4c44ba4b44b658cd8efe`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:47.950169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:48.018812 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1239/2449] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:48.030205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:48.031997 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:48.088541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b0cee-c8a0-4d60-aca5-52f31158899c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:48.092119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:48.092706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.092982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.093248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.102144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:48.103543 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:48.113151 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1211/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:48.185811 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:48.195993 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102ad30-a0bb-4b0a-8f02-3dc3a3e3e81c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:48.199541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfc26d-6e88-4650-9e53-5062315f3f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:48.200184 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc26d-6e88-4650-9e53-5062315f3f9c service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.200460 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc26d-6e88-4650-9e53-5062315f3f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.200728 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfc26d-6e88-4650-9e53-5062315f3f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.257226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc26d-6e88-4650-9e53-5062315f3f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:48.258697 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfc26d-6e88-4650-9e53-5062315f3f9c service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:48.267784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1240/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:21:48.528264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:48.573669 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:48.591953 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea2ade-fd35-45be-91df-c2424acf669a service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:48.596922 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:48.597549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.597830 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.598095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] PATH_INFO: `/v3/users/1af03c649cce4319816a8302cbdbcd59` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.599579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af03c649cce4319816a8302cbdbcd59)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:48.601739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:48.651620 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af03c649cce4319816a8302cbdbcd59'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.659541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af03c649cce4319816a8302cbdbcd59'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.660239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af03c649cce4319816a8302cbdbcd59'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.660842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af03c649cce4319816a8302cbdbcd59'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.669188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af03c649cce4319816a8302cbdbcd59'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.689264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1212/2452] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:48 2022] DELETE /identity/v3/users/1af03c649cce4319816a8302cbdbcd59 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:48.693804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.694094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.694368 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.714154 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:48.715352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:48.729004 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:48.730412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:48.778959 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1241/2453] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:48.790002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:48.791410 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:48.798521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929291ea-2931-44ce-a219-bb538056a4b8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:48.803222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:48.803856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.804159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.804443 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] PATH_INFO: `/v3/users/817bb24046624883b301e9d86cef745a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.805576 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=817bb24046624883b301e9d86cef745a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:48.807477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:48.825231 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:48.850057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae630eb8-e0fd-4ef2-bd35-39d38c0670d8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:48.854032 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1cb6b-837b-4e64-9303-9287afda519f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:48.854641 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1cb6b-837b-4e64-9303-9287afda519f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.854922 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1cb6b-837b-4e64-9303-9287afda519f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.855198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1cb6b-837b-4e64-9303-9287afda519f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.856905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817bb24046624883b301e9d86cef745a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.864804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1cb6b-837b-4e64-9303-9287afda519f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:48.865146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817bb24046624883b301e9d86cef745a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.865879 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817bb24046624883b301e9d86cef745a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.866256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1cb6b-837b-4e64-9303-9287afda519f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:48.866500 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817bb24046624883b301e9d86cef745a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.873673 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817bb24046624883b301e9d86cef745a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:48.876176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1242/2454] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:48.876549 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:48.895538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1213/2455] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:48 2022] DELETE /identity/v3/users/817bb24046624883b301e9d86cef745a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:48.900330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:48.900654 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:48.900928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:48.920402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:48.921597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:48.989633 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1243/2456] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:48.999285 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:49.001098 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:49.066424 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8026cb-231c-427b-9189-af7d0dc3d51d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:49.070146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:49.070758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:49.071040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:49.071312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:49.081043 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:49.082460 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:49.092093 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1214/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:49.179099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:49.180543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:49.193249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c81fee-41b6-43c4-b074-ac5a252d9d6f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:49.198909 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:49.199645 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:49.199931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:49.200279 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] PATH_INFO: `/v3/projects/a9c91a4faeed4162af54da7ba8fecf4e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:49.201463 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9c91a4faeed4162af54da7ba8fecf4e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:49.203929 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:49.256176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9c91a4faeed4162af54da7ba8fecf4e', 'request_id': 'req-a7caa0ef-10e8-43e6-9e14-09d8e4778285'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.263684 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9c91a4faeed4162af54da7ba8fecf4e', 'request_id': 'req-a7caa0ef-10e8-43e6-9e14-09d8e4778285'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.270591 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9c91a4faeed4162af54da7ba8fecf4e', 'request_id': 'req-a7caa0ef-10e8-43e6-9e14-09d8e4778285'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.281440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] The token cache is being invalidate because project a9c91a4faeed4162af54da7ba8fecf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:49.281674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.282874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.284418 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1244/2458] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:49 2022] DELETE /identity/v3/projects/a9c91a4faeed4162af54da7ba8fecf4e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:49.288569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:49.298300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4dbc5-d666-4155-a628-c823d4f9c847 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:49.359694 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:49.360374 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:49.360659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:49.360936 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] PATH_INFO: `/v3/users/cb536d88ecbe4c44ba4b44b658cd8efe` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:49.362222 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb536d88ecbe4c44ba4b44b658cd8efe)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:49.364276 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:49.415849 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:49.416749 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb536d88ecbe4c44ba4b44b658cd8efe'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.417425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:49.426261 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb536d88ecbe4c44ba4b44b658cd8efe'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.427129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb536d88ecbe4c44ba4b44b658cd8efe'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.427923 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb536d88ecbe4c44ba4b44b658cd8efe'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.433543 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7caa0ef-10e8-43e6-9e14-09d8e4778285 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:49.436434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb536d88ecbe4c44ba4b44b658cd8efe'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.438658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:49.439923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:49.440165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:49.440437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] PATH_INFO: `/v3/projects/76b9c15bc5d54f25b881c2662bd01fc9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:49.441782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b9c15bc5d54f25b881c2662bd01fc9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:49.443757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:49.458128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1215/2459] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:49 2022] DELETE /identity/v3/users/cb536d88ecbe4c44ba4b44b658cd8efe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:49.493404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b9c15bc5d54f25b881c2662bd01fc9', 'request_id': 'req-17f74197-80f8-47c8-9954-c27eb8337ef7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.497005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:49.502822 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b9c15bc5d54f25b881c2662bd01fc9', 'request_id': 'req-17f74197-80f8-47c8-9954-c27eb8337ef7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.512175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b9c15bc5d54f25b881c2662bd01fc9', 'request_id': 'req-17f74197-80f8-47c8-9954-c27eb8337ef7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.524658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] The token cache is being invalidate because project 76b9c15bc5d54f25b881c2662bd01fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:49.524953 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.525830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.527581 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1245/2460] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:49 2022] DELETE /identity/v3/projects/76b9c15bc5d54f25b881c2662bd01fc9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:49.532016 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:49.533579 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:49.540417 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:49.608107 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c236278-9ba6-4e18-93f9-82a85b067cfb admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:49.670876 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:49.671619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:49.671939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:49.672223 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] PATH_INFO: `/v3/users/13ba7659f3f14dd6a0955ebcbec9b42a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:49.673409 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ba7659f3f14dd6a0955ebcbec9b42a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:49.676073 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:49.727407 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ba7659f3f14dd6a0955ebcbec9b42a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.734671 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ba7659f3f14dd6a0955ebcbec9b42a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.735473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ba7659f3f14dd6a0955ebcbec9b42a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.736757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ba7659f3f14dd6a0955ebcbec9b42a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.744768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ba7659f3f14dd6a0955ebcbec9b42a'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:49.763536 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1216/2461] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:49 2022] DELETE /identity/v3/users/13ba7659f3f14dd6a0955ebcbec9b42a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:50.070263 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.071753 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.088215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f74197-80f8-47c8-9954-c27eb8337ef7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.109124 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.110784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.151760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:50.156604 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.157300 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.157713 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.158718 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] PATH_INFO: `/v3/projects/f4c3400632a544c484e1abd365947c2e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.159858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4c3400632a544c484e1abd365947c2e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.162005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.185195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff414d1-a1b6-4db6-ba34-3b1d9ca46295 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.189889 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.190567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.190817 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.191115 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] PATH_INFO: `/v3/projects/0b6c267a66284312aba7ae0c30fd0271` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.192267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6c267a66284312aba7ae0c30fd0271)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.194102 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.210375 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4c3400632a544c484e1abd365947c2e', 'request_id': 'req-7280be46-a25a-4d98-9fa6-02654999fb59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.217833 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4c3400632a544c484e1abd365947c2e', 'request_id': 'req-7280be46-a25a-4d98-9fa6-02654999fb59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.225116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4c3400632a544c484e1abd365947c2e', 'request_id': 'req-7280be46-a25a-4d98-9fa6-02654999fb59'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.236432 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] The token cache is being invalidate because project f4c3400632a544c484e1abd365947c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:50.236726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.237377 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7280be46-a25a-4d98-9fa6-02654999fb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.238877 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1246/2462] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:50 2022] DELETE /identity/v3/projects/f4c3400632a544c484e1abd365947c2e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:50.240272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6c267a66284312aba7ae0c30fd0271', 'request_id': 'req-42058426-a292-4ede-97aa-f16748e57641'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.243590 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c2514-a89a-46b6-b286-06171040629b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.243965 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c2514-a89a-46b6-b286-06171040629b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.244363 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c2514-a89a-46b6-b286-06171040629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.247845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6c267a66284312aba7ae0c30fd0271', 'request_id': 'req-42058426-a292-4ede-97aa-f16748e57641'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.255129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6c267a66284312aba7ae0c30fd0271', 'request_id': 'req-42058426-a292-4ede-97aa-f16748e57641'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.265168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8e9c2514-a89a-46b6-b286-06171040629b None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:50.266375 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] The token cache is being invalidate because project 0b6c267a66284312aba7ae0c30fd0271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:50.266508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8e9c2514-a89a-46b6-b286-06171040629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.266668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.267317 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-42058426-a292-4ede-97aa-f16748e57641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:50.269436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1217/2463] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:50 2022] DELETE /identity/v3/projects/0b6c267a66284312aba7ae0c30fd0271 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:50.274385 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b6b0-dbc1-4c63-9491-114435e498e1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.274678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b6b0-dbc1-4c63-9491-114435e498e1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.275079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b6b0-dbc1-4c63-9491-114435e498e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.294867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5fa5b6b0-dbc1-4c63-9491-114435e498e1 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:50.296108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5fa5b6b0-dbc1-4c63-9491-114435e498e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.327199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1247/2464] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:50.336765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.337054 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.337330 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.355018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1218/2465] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:50.357269 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:50.358464 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.362733 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.363023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.363293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.366882 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1248/2466] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:50.370688 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.379583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42cbe74-fa7f-4740-84b7-544efc938544 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.384116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:50.384244 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.384738 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.385019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.385293 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.385401 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.385923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:50.386220 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.387781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.389288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:50.394721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1219/2467] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:50.399039 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.403271 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1249/2468] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:21:50.407491 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.412231 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec41aa3-1c82-46bc-a0a7-42171e0cee85 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.416850 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.417442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.417720 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.417989 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.418109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148f17-eddf-415b-8184-7bedd6c0442f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.418681 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:50.418920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.420567 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.422941 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.423536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.424022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.424299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.424913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.426804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.433147 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1220/2469] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:21:50.437224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.447410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5819b-0d7f-4f63-af13-06ec6ee7b116 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.452069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.452653 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.452931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.453217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.453856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.454249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1250/2470] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:50.456479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.458658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.484857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1221/2471] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:50.489468 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.510159 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:50.523889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66fa86-3ad6-4365-a2ee-4cbd9abd4ee9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.552333 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94627a6-d5d4-4cd8-9baa-f89bc5ccdc2b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.557201 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.557801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.558081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.558353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.558982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.561055 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.580016 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.580649 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.580926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.581199 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.581816 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.583514 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1222/2472] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/users => generated 304 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:50.584094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.587772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.598164 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b36d3-87a2-4f60-acf9-3a73b7fbe198 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.603068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.603684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.603996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.604295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.604931 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.606513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.606644 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1251/2473] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:50.610561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.619402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1223/2474] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:21:50.621000 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5282bfe-5174-4ab2-b87f-c9194f827ee9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.623152 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.625583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.626173 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.626453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.626748 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.627400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.629029 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.632993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfdb50-6a07-469e-a1c7-f2a0981a1fe2 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.637605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.638212 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.638497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.638772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.641890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1252/2475] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:21:50.641993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.641993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.642558 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.651788 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c801484-3d46-45cd-a7a3-058f95b0fcca admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.656125 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1224/2476] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:50.656676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.656920 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.657272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.657557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.657830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.659002 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.660607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.666758 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a0731-0154-4cec-8058-a703694f12c9 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.671294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dd176-4b4b-4a6f-b441-0914c4c03569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.671967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dd176-4b4b-4a6f-b441-0914c4c03569 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.675804 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1253/2477] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:21:50.675957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dd176-4b4b-4a6f-b441-0914c4c03569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.675957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dd176-4b4b-4a6f-b441-0914c4c03569 admin admin] PATH_INFO: `/v3/projects/dd72a689e53b4ef4af2b850eb2780a84/users/26440bfd2d9c4063902bddcee7e4714d/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.677724 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.687707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dd176-4b4b-4a6f-b441-0914c4c03569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd72a689e53b4ef4af2b850eb2780a84, user_id=26440bfd2d9c4063902bddcee7e4714d, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.688461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f421-2131-454e-8ea3-3f6f2901c5d0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.690372 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dd176-4b4b-4a6f-b441-0914c4c03569 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.693169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f310d4f-f7bd-4d9b-9991-52b5f3a14ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.693819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310d4f-f7bd-4d9b-9991-52b5f3a14ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.694083 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310d4f-f7bd-4d9b-9991-52b5f3a14ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.694357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f310d4f-f7bd-4d9b-9991-52b5f3a14ef8 admin admin] PATH_INFO: `/v3/projects/0a43fe9a921246348c0543585aa14578/users/de3197afe340450fa34cecb253f80802/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.703068 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1225/2478] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:50 2022] PUT /identity/v3/projects/dd72a689e53b4ef4af2b850eb2780a84/users/26440bfd2d9c4063902bddcee7e4714d/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:50.709658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f310d4f-f7bd-4d9b-9991-52b5f3a14ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a43fe9a921246348c0543585aa14578, user_id=de3197afe340450fa34cecb253f80802, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.712388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f310d4f-f7bd-4d9b-9991-52b5f3a14ef8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.714538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.714929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.715287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.725832 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1254/2479] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:50 2022] PUT /identity/v3/projects/0a43fe9a921246348c0543585aa14578/users/de3197afe340450fa34cecb253f80802/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:50.730602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.730895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.731175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.744959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] MFA Rules not processed for user `26440bfd2d9c4063902bddcee7e4714d`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:50.746161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.751350 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:50.752579 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.768691 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:50.811293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1226/2480] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:50.812896 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1255/2481] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:21:50.816045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.822435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.823901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:50.826336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff28bc7-6b44-44b1-b3e2-b3a125b1c7a3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.831465 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.832090 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.832368 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.832736 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.833390 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.835247 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.866359 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1227/2482] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:50.867448 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.882108 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9959ac9-4c43-4667-a35d-db3a0ccaae6f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.900405 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:50.930866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccc3d4-2668-4493-bf8b-5a37cd4dca5a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.932569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.933352 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.933627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.933895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.935594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.936295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.936580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.936853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.937483 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.939978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.944291 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.945824 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.957386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1256/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:21:50.964001 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1228/2484] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:50 2022] POST /identity/v3/users => generated 310 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:50.967836 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:50.977709 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b873e-9515-447a-93c4-845ceab388b6 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:50.982969 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:50.983636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:50.984005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:50.984306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:50.984958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:50.987429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:50.998217 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1257/2485] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:51.003108 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.013136 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec2f02-689f-4783-a201-0697171d7943 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.017992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.018675 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.018975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.019267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] PATH_INFO: `/v3/projects/e7c4b9c5458b47e4b8630205ace8bfb1/users/b39793e0d2dc47fab2badc9e9d276dd8/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.034236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c4b9c5458b47e4b8630205ace8bfb1, user_id=b39793e0d2dc47fab2badc9e9d276dd8, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.037017 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.051316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1229/2486] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:51 2022] PUT /identity/v3/projects/e7c4b9c5458b47e4b8630205ace8bfb1/users/b39793e0d2dc47fab2badc9e9d276dd8/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:51.055095 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.065726 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590d8b2-6047-44b5-9a50-7873707f2b1f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.124961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a10831-eae0-4e3b-b0f2-2969a1db548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.125600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a10831-eae0-4e3b-b0f2-2969a1db548e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.125853 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a10831-eae0-4e3b-b0f2-2969a1db548e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.126131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a10831-eae0-4e3b-b0f2-2969a1db548e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.127415 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a10831-eae0-4e3b-b0f2-2969a1db548e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.129272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a10831-eae0-4e3b-b0f2-2969a1db548e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.141683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1258/2487] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:51.146094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.157141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd48a-7815-4ff2-a1a1-ed02b6ae352b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.161916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.162650 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.163013 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.163353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] PATH_INFO: `/v3/projects/e7c4b9c5458b47e4b8630205ace8bfb1/users/b39793e0d2dc47fab2badc9e9d276dd8/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.165734 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c4b9c5458b47e4b8630205ace8bfb1, user_id=b39793e0d2dc47fab2badc9e9d276dd8, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.168494 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.179995 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1230/2488] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:51 2022] PUT /identity/v3/projects/e7c4b9c5458b47e4b8630205ace8bfb1/users/b39793e0d2dc47fab2badc9e9d276dd8/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:51.190999 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.191290 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.191576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.205893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:51.222531 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] MFA Rules not processed for user `b39793e0d2dc47fab2badc9e9d276dd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:51.224428 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:51.302978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1259/2489] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:51 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:51.311377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.314187 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:51.388437 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efe1f3-fec0-4f20-a488-3bc16218f0db admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.392268 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9279ac-c43a-496b-9bb5-57522b07933d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.392921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9279ac-c43a-496b-9bb5-57522b07933d service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.393241 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9279ac-c43a-496b-9bb5-57522b07933d service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.393515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9279ac-c43a-496b-9bb5-57522b07933d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.404167 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9279ac-c43a-496b-9bb5-57522b07933d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.405594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9279ac-c43a-496b-9bb5-57522b07933d service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.415759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1231/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:51 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:51.571396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.581854 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df8df-ad6f-4138-887f-e8d0e95f9fc8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.585607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.586348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.586685 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.587360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.617580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.617872 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.618206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.646280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] MFA Rules not processed for user `de3197afe340450fa34cecb253f80802`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:51.647499 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:51.654356 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.656308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.668168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1260/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:51 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:51.742042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1232/2492] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:51.743039 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.819249 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284ab4c-6b82-4ade-9428-3d899444a87f service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.824926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.825978 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.826265 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.826540 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.827185 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.829139 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.857496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1261/2493] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:51 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:51.861619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.872655 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9311722-e0fa-4cc7-bf56-cd429167d818 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.884371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:51.933279 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.944444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.944444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.944444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.944444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.944444 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:51.968902 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1233/2494] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:51 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:51.971150 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:51.984974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2786-5b13-4631-9508-87ac1df3da34 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:51.992829 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:51.993399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:51.993683 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:51.993958 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:51.994614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:51.996253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:52.011414 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1262/2495] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:52.013267 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:52.025015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbcbd0-028a-40c5-9b2f-7ab5eaaf8397 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:52.029901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:52.030632 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:52.030988 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:52.031330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] PATH_INFO: `/v3/projects/4987bc7d81e14dc4aeb1dff52ec97d5e/users/f741f4e72d2845b3af628dc5ee9bcda8/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:52.048343 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4987bc7d81e14dc4aeb1dff52ec97d5e, user_id=f741f4e72d2845b3af628dc5ee9bcda8, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:52.051033 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:52.064478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1234/2496] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:52 2022] PUT /identity/v3/projects/4987bc7d81e14dc4aeb1dff52ec97d5e/users/f741f4e72d2845b3af628dc5ee9bcda8/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:52.068632 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:52.074900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:52.078671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc0592-49ce-4a14-801d-410e01621b0a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:52.134397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc9f33-a6ba-4c2c-8137-2a206c7881eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:52.135047 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9f33-a6ba-4c2c-8137-2a206c7881eb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:52.135252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9f33-a6ba-4c2c-8137-2a206c7881eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:52.135521 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc9f33-a6ba-4c2c-8137-2a206c7881eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:52.136210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9f33-a6ba-4c2c-8137-2a206c7881eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:52.137784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc9f33-a6ba-4c2c-8137-2a206c7881eb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:52.147664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1263/2497] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:21:52.152202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:52.162330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e44ab9-49eb-4cc3-8403-48e205756b79 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:52.166900 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac0fd7-eede-4891-b6df-8cc35bba315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:52.167534 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0fd7-eede-4891-b6df-8cc35bba315b admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:52.167811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0fd7-eede-4891-b6df-8cc35bba315b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:52.168116 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac0fd7-eede-4891-b6df-8cc35bba315b admin admin] PATH_INFO: `/v3/projects/4987bc7d81e14dc4aeb1dff52ec97d5e/users/f741f4e72d2845b3af628dc5ee9bcda8/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:52.170005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0fd7-eede-4891-b6df-8cc35bba315b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4987bc7d81e14dc4aeb1dff52ec97d5e, user_id=f741f4e72d2845b3af628dc5ee9bcda8, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:52.172630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac0fd7-eede-4891-b6df-8cc35bba315b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:52.182487 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1235/2498] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:52 2022] PUT /identity/v3/projects/4987bc7d81e14dc4aeb1dff52ec97d5e/users/f741f4e72d2845b3af628dc5ee9bcda8/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:52.805569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:52.805856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:52.806127 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:52.833536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] MFA Rules not processed for user `f741f4e72d2845b3af628dc5ee9bcda8`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:52.834676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:52.904472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1264/2499] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:52.971298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:52.971584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:52.971858 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:52.992747 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] MFA Rules not processed for user `de3197afe340450fa34cecb253f80802`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:52.993963 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:53.049980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1236/2500] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:53.065504 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:53.067062 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:53.144899 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b3ba-90f5-4b82-bfa4-5ee5966cdeef None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:53.150536 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:53.151142 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:53.151425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:53.151694 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:53.159667 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:53.161284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:53.170096 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1265/2501] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:53.212428 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:53.213917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:53.278695 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b70f3-b7c0-4fcd-b339-79621b9e647f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:53.282306 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:53.282941 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:53.283219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:53.283491 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:53.285249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:53.299769 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:53.301393 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:53.313768 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1237/2502] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:53.845865 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:53.847346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:53.860792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:53.909298 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d96bbf-bd17-4652-8fa7-8ee2341bfde6 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:53.913020 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:53.913631 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:53.913914 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:53.914187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:53.915916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:53.930447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:53.931928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7a667-9a76-4d61-95e6-bacefd1ab5c5 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:53.943673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1266/2503] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:56.981635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:56.999109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:57.044089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b07ca-8d48-4e6c-80b4-64ce928be691 service glance] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:57.048638 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:57.049263 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:57.049545 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:57.049820 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] PATH_INFO: `/v3/users/26440bfd2d9c4063902bddcee7e4714d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:57.050921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26440bfd2d9c4063902bddcee7e4714d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:57.052853 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:57.097706 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26440bfd2d9c4063902bddcee7e4714d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.104707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26440bfd2d9c4063902bddcee7e4714d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.105364 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26440bfd2d9c4063902bddcee7e4714d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.105969 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26440bfd2d9c4063902bddcee7e4714d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.113142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26440bfd2d9c4063902bddcee7e4714d'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.130266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1238/2504] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:56 2022] DELETE /identity/v3/users/26440bfd2d9c4063902bddcee7e4714d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:57.134777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:57.135235 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:57.135332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:57.154393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:57.155623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:57.217808 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1267/2505] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:57.228718 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:57.230184 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:57.289497 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a711128-28ec-4db5-9ad3-9c1b41d00bb2 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:57.293121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:57.293717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:57.293992 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:57.294264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:57.303897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:57.305320 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:57.316387 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1239/2506] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:57.618830 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:57.620390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:57.638327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8ae51-ed36-4dd9-b739-46b70a0ec850 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:57.643222 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:57.643857 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:57.644166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:57.644438 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] PATH_INFO: `/v3/projects/dd72a689e53b4ef4af2b850eb2780a84` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:57.645559 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd72a689e53b4ef4af2b850eb2780a84)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:57.647458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:57.697607 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd72a689e53b4ef4af2b850eb2780a84', 'request_id': 'req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.705089 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd72a689e53b4ef4af2b850eb2780a84', 'request_id': 'req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.711731 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd72a689e53b4ef4af2b850eb2780a84', 'request_id': 'req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.724384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] The token cache is being invalidate because project dd72a689e53b4ef4af2b850eb2780a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:57.724796 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.725789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.727366 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1268/2507] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:57 2022] DELETE /identity/v3/projects/dd72a689e53b4ef4af2b850eb2780a84 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:57.731631 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:57.742950 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18576-7a85-42dd-b4ba-12fc1d5248b5 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:57.778676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:57.802958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:57.803583 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:57.803862 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:57.804161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] PATH_INFO: `/v3/users/b39793e0d2dc47fab2badc9e9d276dd8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:57.805411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39793e0d2dc47fab2badc9e9d276dd8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:57.807678 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:57.852078 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39793e0d2dc47fab2badc9e9d276dd8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.859023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39793e0d2dc47fab2badc9e9d276dd8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.859667 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39793e0d2dc47fab2badc9e9d276dd8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.860277 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39793e0d2dc47fab2badc9e9d276dd8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.867410 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-5bd06590-b910-4b01-ae83-8798309fa218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39793e0d2dc47fab2badc9e9d276dd8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:57.883934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1240/2508] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:57 2022] DELETE /identity/v3/users/b39793e0d2dc47fab2badc9e9d276dd8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:58.152544 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.154003 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:58.167926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0a7c1-4edc-46c5-b35c-ea3aa73f6617 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.203012 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:58.228131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.228761 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.229046 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.229323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] PATH_INFO: `/v3/projects/e7c4b9c5458b47e4b8630205ace8bfb1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.230436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c4b9c5458b47e4b8630205ace8bfb1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.232413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.278552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c4b9c5458b47e4b8630205ace8bfb1', 'request_id': 'req-0fd85d73-e30f-4665-ac73-e15846f634af'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:58.285566 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c4b9c5458b47e4b8630205ace8bfb1', 'request_id': 'req-0fd85d73-e30f-4665-ac73-e15846f634af'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:58.291661 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c4b9c5458b47e4b8630205ace8bfb1', 'request_id': 'req-0fd85d73-e30f-4665-ac73-e15846f634af'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:58.302169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] The token cache is being invalidate because project e7c4b9c5458b47e4b8630205ace8bfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:58.302461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:58.303084 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0fd85d73-e30f-4665-ac73-e15846f634af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:58.304594 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1269/2509] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:58 2022] DELETE /identity/v3/projects/e7c4b9c5458b47e4b8630205ace8bfb1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:21:58.310295 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.310801 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.310901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.330743 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:58.331986 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:58.406593 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1241/2510] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:58.415164 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.415461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.415789 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.439845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:58.440629 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:58.448843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1270/2511] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:58.453297 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.462809 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c93d-efb2-42bf-8c50-0456855a896e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.467628 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.468260 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.468553 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.468819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.469461 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:58.469757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.471932 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.487909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1242/2512] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:21:58.489597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.498878 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced53c8-8495-4e33-9478-b2688ac0c5c6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.503472 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.504116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.504400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.504673 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.505297 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.507187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.536529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1271/2513] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:58.540753 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.550865 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc28082-2b35-46b2-822e-92accc5252ed admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.593919 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:58.611434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.612082 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.612412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.612693 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.613327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.615250 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.639917 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1243/2514] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:58 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:21:58.641080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.652454 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5599e5-c22b-442c-a0a5-e9bc9cad93b8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.658398 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.659023 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.659303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.659574 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.660259 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.661846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.672937 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1272/2515] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:21:58.676717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.687031 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f32b-1f13-4dd4-9e83-d49d4fc47132 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.692419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057e88b-c6ab-4cc5-b0a6-1e655d1c254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.693035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e88b-c6ab-4cc5-b0a6-1e655d1c254f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.693316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e88b-c6ab-4cc5-b0a6-1e655d1c254f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.693584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e88b-c6ab-4cc5-b0a6-1e655d1c254f admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.694234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057e88b-c6ab-4cc5-b0a6-1e655d1c254f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.695825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057e88b-c6ab-4cc5-b0a6-1e655d1c254f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.708826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1244/2516] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:21:58.713166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.724053 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb2882-badb-4c96-9f14-34ecc0b0433d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.735396 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.736246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.736542 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.736841 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] PATH_INFO: `/v3/projects/e75a85a12653471fafa3d11d445b2722/users/d0ecde031a964ac099da29016bbd44cc/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.752129 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75a85a12653471fafa3d11d445b2722, user_id=d0ecde031a964ac099da29016bbd44cc, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.754767 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.768151 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1273/2517] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:21:58 2022] PUT /identity/v3/projects/e75a85a12653471fafa3d11d445b2722/users/d0ecde031a964ac099da29016bbd44cc/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:58.779367 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.779739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.780050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.811647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] MFA Rules not processed for user `d0ecde031a964ac099da29016bbd44cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:58.813168 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:58.881652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1245/2518] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:58.892928 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:58.894847 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:58.967455 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40d4b5-3738-40fe-be1f-a43adb610b84 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:58.971795 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcf475-88e8-4de2-8ab6-08efc14b1cf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:58.972435 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcf475-88e8-4de2-8ab6-08efc14b1cf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:58.972715 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcf475-88e8-4de2-8ab6-08efc14b1cf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:58.973075 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcf475-88e8-4de2-8ab6-08efc14b1cf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:58.981981 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcf475-88e8-4de2-8ab6-08efc14b1cf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:58.983448 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcf475-88e8-4de2-8ab6-08efc14b1cf1 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:58.993215 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1274/2519] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:21:59.018262 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:59.080217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304943b0-6935-4174-a71a-79d8469c3f17 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:59.084821 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:59.085453 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.085735 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.086010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] PATH_INFO: `/v3/users/d0ecde031a964ac099da29016bbd44cc` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.087130 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ecde031a964ac099da29016bbd44cc)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:59.089066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:59.134825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ecde031a964ac099da29016bbd44cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.139935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:59.141934 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ecde031a964ac099da29016bbd44cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.142827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ecde031a964ac099da29016bbd44cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.143791 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ecde031a964ac099da29016bbd44cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.151544 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ecde031a964ac099da29016bbd44cc'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.169049 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1246/2520] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:21:59 2022] DELETE /identity/v3/users/d0ecde031a964ac099da29016bbd44cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:59.173956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.174413 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.174524 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.187893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:21:59.193946 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:59.196146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:59.253919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1275/2521] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:59.263418 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:59.264826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:59.320441 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8943985-f7d6-4268-b9f7-63138c7d6bf8 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:59.324091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfff9-7e9a-4961-bfc9-8c0a4c8df103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:59.324680 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfff9-7e9a-4961-bfc9-8c0a4c8df103 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.324957 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfff9-7e9a-4961-bfc9-8c0a4c8df103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.325228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfff9-7e9a-4961-bfc9-8c0a4c8df103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.334564 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfff9-7e9a-4961-bfc9-8c0a4c8df103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:59.336007 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfff9-7e9a-4961-bfc9-8c0a4c8df103 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:59.346316 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1247/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:21:59.607895 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:59.609360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:59.622674 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20cffd-ce19-41e0-8207-95f02c4a596d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:59.627984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:59.628621 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.628900 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.629292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] PATH_INFO: `/v3/projects/e75a85a12653471fafa3d11d445b2722` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.630506 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75a85a12653471fafa3d11d445b2722)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:59.632443 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:59.677831 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75a85a12653471fafa3d11d445b2722', 'request_id': 'req-77093510-faf6-40b1-9f04-45cedc140fb6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.684901 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75a85a12653471fafa3d11d445b2722', 'request_id': 'req-77093510-faf6-40b1-9f04-45cedc140fb6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.691606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75a85a12653471fafa3d11d445b2722', 'request_id': 'req-77093510-faf6-40b1-9f04-45cedc140fb6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.701646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] The token cache is being invalidate because project e75a85a12653471fafa3d11d445b2722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:21:59.701932 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.702549 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-77093510-faf6-40b1-9f04-45cedc140fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:21:59.704098 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1276/2523] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:21:59 2022] DELETE /identity/v3/projects/e75a85a12653471fafa3d11d445b2722 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:21:59.709670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.709958 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.710234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.729349 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:59.730521 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:59.790484 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1248/2524] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:59.798407 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.798693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.798974 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.819087 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:21:59.820331 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:21:59.828230 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1277/2525] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:21:59.833109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:59.842685 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6a377-5768-47cf-8dd3-775aed7397a8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:59.847660 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:59.848300 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.848582 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.848857 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.849524 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:21:59.849827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:59.851665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:59.862955 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1249/2526] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:21:59.867169 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:59.876820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc7623-3cff-4a3f-903c-aa6dad73ee8f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:59.881402 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:59.881983 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.882260 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.882528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.883186 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:59.885099 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:59.912074 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1278/2527] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:21:59 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:21:59.916272 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:21:59.926336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cf567-1d51-4557-8f6a-aec9fb39f658 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:21:59.984825 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:21:59.985434 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:21:59.986296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:21:59.986575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:21:59.987219 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:21:59.989185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:21:59.998913 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:00.016052 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1250/2528] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:21:59 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:22:00.018773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:00.029122 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfd4d2-e0e3-49e8-bd08-bae0dc87bb28 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:00.033787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:00.034386 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:00.034670 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:00.034961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:00.035585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:00.037252 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:00.047094 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1279/2529] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:22:00.051575 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:00.062172 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9424ea-8ec7-463c-96db-028d9825f0c3 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:00.067470 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b27eb9-b8e3-4785-8df3-6f6d60b45f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:00.068100 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27eb9-b8e3-4785-8df3-6f6d60b45f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:00.068380 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27eb9-b8e3-4785-8df3-6f6d60b45f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:00.068651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b27eb9-b8e3-4785-8df3-6f6d60b45f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:00.069281 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b27eb9-b8e3-4785-8df3-6f6d60b45f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:00.070878 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b27eb9-b8e3-4785-8df3-6f6d60b45f34 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:00.084456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1251/2530] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:00.085596 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:00.095940 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361ce8b-d2f4-463e-800f-3228989a2a3a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:00.101622 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:00.102286 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:00.102563 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:00.102846 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] PATH_INFO: `/v3/projects/b9a3e539493e450ba8dd41d029e8dab5/users/e5885ed3727047a19a49bb930daf9d28/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:00.118519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a3e539493e450ba8dd41d029e8dab5, user_id=e5885ed3727047a19a49bb930daf9d28, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:00.121541 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:00.135192 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1280/2531] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:00 2022] PUT /identity/v3/projects/b9a3e539493e450ba8dd41d029e8dab5/users/e5885ed3727047a19a49bb930daf9d28/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:00.140129 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31540-57af-448b-ab24-15599325a24a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:00.140442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31540-57af-448b-ab24-15599325a24a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:00.140714 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31540-57af-448b-ab24-15599325a24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:00.160436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-01b31540-57af-448b-ab24-15599325a24a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:00.161636 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-01b31540-57af-448b-ab24-15599325a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:00.218525 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1252/2532] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:00.228349 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:00.230116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:00.260942 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:00.288057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce47b0-4e7c-456c-9497-970a7d0f3e9f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:00.291703 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b663e0-ac88-4560-a333-9ff511e7a66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:00.292364 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b663e0-ac88-4560-a333-9ff511e7a66a service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:00.292651 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b663e0-ac88-4560-a333-9ff511e7a66a service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:00.293033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b663e0-ac88-4560-a333-9ff511e7a66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:00.302501 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b663e0-ac88-4560-a333-9ff511e7a66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:00.303939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b663e0-ac88-4560-a333-9ff511e7a66a service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:00.313299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1281/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:04.566360 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b31540-57af-448b-ab24-15599325a24a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:04.567827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-01b31540-57af-448b-ab24-15599325a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:04.643067 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b31540-57af-448b-ab24-15599325a24a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:04.646891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:04.647508 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:04.647784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:04.648088 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:04.649815 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:04.664935 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:04.665434 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:04.665520 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:04.700449 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] MFA Rules not processed for user `e5885ed3727047a19a49bb930daf9d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:04.702188 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:04.731442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:04.732975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:04.746721 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1253/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:22:04.777339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1282/2535] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:04.781897 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:04.794498 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babfc5-0b3c-43f4-a96c-bca90abb5318 service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:04.801050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:04.801668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:04.801948 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:04.802217 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:04.802909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:04.804961 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:04.835906 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1254/2536] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:22:04 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:04.841181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:04.855777 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafdb38-a249-4302-bf96-8503aeb6f931 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:04.932202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:04.932913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:04.933261 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:04.933603 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:04.934332 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:04.936353 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:04.967864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1283/2537] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:22:04 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:04.969112 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:04.981687 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc1f9f-98e4-40ff-9b0d-6eec949d28b9 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:04.988456 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:04.989221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:04.989504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:04.989833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:04.990777 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:04.992729 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:04.995153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:05.006637 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1255/2538] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:05.010550 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:05.022643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49deb2-02f5-44ac-a9b6-a4c4bd8cdd73 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:05.028496 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:05.029445 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:05.029867 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:05.030175 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] PATH_INFO: `/v3/projects/1590bce2a4c74f738fbecdfd3b062766/users/b1c5d9729f6346b3a4f923ec8f8ee769/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:05.047809 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1590bce2a4c74f738fbecdfd3b062766, user_id=b1c5d9729f6346b3a4f923ec8f8ee769, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:05.050817 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:05.069406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1284/2539] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:05 2022] PUT /identity/v3/projects/1590bce2a4c74f738fbecdfd3b062766/users/b1c5d9729f6346b3a4f923ec8f8ee769/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:22:05.073023 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:05.092739 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0f3c0-a479-4fd1-a92d-e26e39e7af23 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:05.162069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e9528-4ae8-4d62-91bd-4bdf4b57afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:05.162790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9528-4ae8-4d62-91bd-4bdf4b57afe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:05.163176 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9528-4ae8-4d62-91bd-4bdf4b57afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:05.163522 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e9528-4ae8-4d62-91bd-4bdf4b57afe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:05.164280 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e9528-4ae8-4d62-91bd-4bdf4b57afe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:05.165938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e9528-4ae8-4d62-91bd-4bdf4b57afe9 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:05.179938 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1256/2540] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:05.182138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:05.194646 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3dcf-79c2-4c97-979c-affc686ab8f4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:05.199326 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:05.200004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:05.200285 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:05.200561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] PATH_INFO: `/v3/projects/1590bce2a4c74f738fbecdfd3b062766/users/b1c5d9729f6346b3a4f923ec8f8ee769/roles/556d482df00b4d4bb6cadd282d1644b3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:05.202469 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1590bce2a4c74f738fbecdfd3b062766, user_id=b1c5d9729f6346b3a4f923ec8f8ee769, role_id=556d482df00b4d4bb6cadd282d1644b3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:05.205699 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:05.216669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1285/2541] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:05 2022] PUT /identity/v3/projects/1590bce2a4c74f738fbecdfd3b062766/users/b1c5d9729f6346b3a4f923ec8f8ee769/roles/556d482df00b4d4bb6cadd282d1644b3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:10.572682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9fd6f-e091-43dd-b8f7-11d40ed1c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:10.573196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9fd6f-e091-43dd-b8f7-11d40ed1c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:10.573319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9fd6f-e091-43dd-b8f7-11d40ed1c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:10.606047 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7ee9fd6f-e091-43dd-b8f7-11d40ed1c0b7 None None] MFA Rules not processed for user `b1c5d9729f6346b3a4f923ec8f8ee769`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:10.607507 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7ee9fd6f-e091-43dd-b8f7-11d40ed1c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:10.678755 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1257/2542] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:10.691635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:10.693659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:10.707669 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:10.755963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45254d9-67c0-429e-aa45-a7b1501a99ef admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:10.759552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4351f9211b24b91b2521d717905dbbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:10.760216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:10.760495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:10.760766 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:10.815552 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:10.817146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:10.825873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1286/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:22:10.971121 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bf77e-631e-4d99-9945-30dd3e7cfb08 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:10.971412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bf77e-631e-4d99-9945-30dd3e7cfb08 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:10.971692 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bf77e-631e-4d99-9945-30dd3e7cfb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:11.036066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e25bf77e-631e-4d99-9945-30dd3e7cfb08 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:11.037274 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e25bf77e-631e-4d99-9945-30dd3e7cfb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:11.081526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:11.118978 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1258/2544] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:11.186022 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:11.187499 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:11.302595 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8706d3-1e68-4ae6-bbbf-57a3b7dd6ace service glance] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:11.307939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:11.308784 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:11.309138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:11.309421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:11.319202 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:11.322124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:11.335004 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1287/2545] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:22:20.403149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7039d1-73f5-4c7e-9a43-3c3071fc4684 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:20.403584 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7039d1-73f5-4c7e-9a43-3c3071fc4684 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:20.403709 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7039d1-73f5-4c7e-9a43-3c3071fc4684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:20.424029 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1d7039d1-73f5-4c7e-9a43-3c3071fc4684 None None] MFA Rules not processed for user `e5885ed3727047a19a49bb930daf9d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:20.425344 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1d7039d1-73f5-4c7e-9a43-3c3071fc4684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:20.433128 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1259/2546] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:21.007306 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:21.008741 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:21.049320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:21.088019 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245793f5-f8c7-435d-8a83-a09f7be56b17 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:21.092938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:21.094138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:21.094421 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:21.094695 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:21.096406 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:21.107927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:21.109515 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:21.119267 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1288/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 17 03:22:22.344060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:22.344633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:22.344633 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:22.367726 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:22.369197 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:22.377882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1260/2548] 10.222.0.20 () {58 vars in 1009 bytes} [Mon Oct 17 03:22:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:22.394458 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:22.406606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c964-4357-40d0-847f-b30a01005ad5 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:22.412041 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:22.412648 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:22.412933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:22.413211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:22.422676 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:22.423856 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:22.433116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1289/2549] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:22:25.807089 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:25.808826 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:25.879580 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756042a-d960-4300-a7d9-ee16c0e6fda6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:25.884585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:25.885481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:25.885947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:25.886376 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] PATH_INFO: `/v3/users/de3197afe340450fa34cecb253f80802` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:25.887831 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3197afe340450fa34cecb253f80802)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:25.890724 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:25.954236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3197afe340450fa34cecb253f80802'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:25.961959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3197afe340450fa34cecb253f80802'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:25.962286 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3197afe340450fa34cecb253f80802'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:25.962921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3197afe340450fa34cecb253f80802'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:25.971175 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3197afe340450fa34cecb253f80802'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:25.993193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1261/2550] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:22:25 2022] DELETE /identity/v3/users/de3197afe340450fa34cecb253f80802 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:26.185573 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:26.218757 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c783f-cb06-46f0-b64a-285f2646a4fe service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:26.281874 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:26.282919 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:26.283430 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:26.283926 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] PATH_INFO: `/v3/projects/0a43fe9a921246348c0543585aa14578` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:26.285483 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a43fe9a921246348c0543585aa14578)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:26.288187 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:26.342787 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a43fe9a921246348c0543585aa14578', 'request_id': 'req-2b87b853-70b5-417c-8464-c1e4f306ce96'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.351466 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a43fe9a921246348c0543585aa14578', 'request_id': 'req-2b87b853-70b5-417c-8464-c1e4f306ce96'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.358624 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a43fe9a921246348c0543585aa14578', 'request_id': 'req-2b87b853-70b5-417c-8464-c1e4f306ce96'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.370650 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] The token cache is being invalidate because project 0a43fe9a921246348c0543585aa14578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:22:26.370995 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.371658 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.373689 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1290/2551] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:22:26 2022] DELETE /identity/v3/projects/0a43fe9a921246348c0543585aa14578 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:26.377774 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:26.379221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:26.393080 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ff4ba-628d-4df8-b83e-c624317c2d01 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:26.442347 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:26.459214 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:26.460012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:26.460432 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:26.460651 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] PATH_INFO: `/v3/users/f741f4e72d2845b3af628dc5ee9bcda8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:26.461819 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f741f4e72d2845b3af628dc5ee9bcda8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:26.463939 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:26.519228 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f741f4e72d2845b3af628dc5ee9bcda8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.526915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f741f4e72d2845b3af628dc5ee9bcda8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.527630 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f741f4e72d2845b3af628dc5ee9bcda8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.528759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f741f4e72d2845b3af628dc5ee9bcda8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.538296 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-1309294b-dacc-44ea-8b9a-d473730618d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f741f4e72d2845b3af628dc5ee9bcda8'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.558784 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1262/2552] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:22:26 2022] DELETE /identity/v3/users/f741f4e72d2845b3af628dc5ee9bcda8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:26.765311 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:26.767065 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:26.783026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87b853-70b5-417c-8464-c1e4f306ce96 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:26.856085 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:26.894384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:26.895289 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:26.895732 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:26.896606 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] PATH_INFO: `/v3/projects/4987bc7d81e14dc4aeb1dff52ec97d5e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:26.897864 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4987bc7d81e14dc4aeb1dff52ec97d5e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:26.899927 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:26.962116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4987bc7d81e14dc4aeb1dff52ec97d5e', 'request_id': 'req-cacaf7b2-99b9-4889-8be1-65285101ad48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.974177 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4987bc7d81e14dc4aeb1dff52ec97d5e', 'request_id': 'req-cacaf7b2-99b9-4889-8be1-65285101ad48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:26.992182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4987bc7d81e14dc4aeb1dff52ec97d5e', 'request_id': 'req-cacaf7b2-99b9-4889-8be1-65285101ad48'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.004159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] The token cache is being invalidate because project 4987bc7d81e14dc4aeb1dff52ec97d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:22:27.004561 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.005323 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cacaf7b2-99b9-4889-8be1-65285101ad48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.007237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1291/2553] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:22:26 2022] DELETE /identity/v3/projects/4987bc7d81e14dc4aeb1dff52ec97d5e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:27.012682 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.013206 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.013502 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.046841 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:27.048249 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:27.117341 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1263/2554] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:27.124747 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.125131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.125519 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.147481 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:27.148858 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:27.158171 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1292/2555] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:27.162806 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.172855 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d005274-837e-4995-9c7f-9a34278e7d76 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.177665 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.178403 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.178757 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.179106 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.179827 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:22:27.180224 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.181833 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.193535 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1264/2556] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:22:27.198038 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.208583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4840c-9557-4013-a24d-4f0579e1c893 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.213355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.213970 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.214253 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.214529 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.215181 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.217132 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.253890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1293/2557] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:22:27 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:27.266645 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.279861 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f02e1-3e49-49bc-b8b9-5533dbe18b43 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.355205 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:27.366330 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.366970 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.367415 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.367688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.368366 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.370504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.395606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1265/2558] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:22:27 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:27.399754 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.411576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190022a0-839e-4d41-ac66-979387fddcfe admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.416921 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.417635 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.417987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.418335 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.419042 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.420800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.432273 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1294/2559] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:22:27.437293 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.447818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3df5f6-9e48-45cf-b87d-fe10013740b7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.453423 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82272549-2b22-4c66-ab83-57d4ea1b951d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.454146 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82272549-2b22-4c66-ab83-57d4ea1b951d admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.454537 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82272549-2b22-4c66-ab83-57d4ea1b951d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.454905 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82272549-2b22-4c66-ab83-57d4ea1b951d admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.455818 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82272549-2b22-4c66-ab83-57d4ea1b951d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.457515 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82272549-2b22-4c66-ab83-57d4ea1b951d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.469402 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1266/2560] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:27.474056 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.484477 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64870c5-a910-4a82-b30f-1addba880dd8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.489494 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.490166 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.490490 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.490769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] PATH_INFO: `/v3/projects/57eea876253e4e3ba50bde0be316eba7/users/6fc145b02e904dcfba34a979bb25dc56/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.507319 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57eea876253e4e3ba50bde0be316eba7, user_id=6fc145b02e904dcfba34a979bb25dc56, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.510057 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.527183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1295/2561] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:27 2022] PUT /identity/v3/projects/57eea876253e4e3ba50bde0be316eba7/users/6fc145b02e904dcfba34a979bb25dc56/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:27.538569 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.538856 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.539135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.569546 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] MFA Rules not processed for user `6fc145b02e904dcfba34a979bb25dc56`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:27.570790 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:27.643155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1267/2562] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:27.655305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.657600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:27.720889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6dbf9-b60c-48ec-89bc-e87ab29dac79 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.724994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26933949-619e-4d2b-a86a-094ef193d03d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.725614 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26933949-619e-4d2b-a86a-094ef193d03d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.725903 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26933949-619e-4d2b-a86a-094ef193d03d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.726182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26933949-619e-4d2b-a86a-094ef193d03d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.736165 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26933949-619e-4d2b-a86a-094ef193d03d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.737619 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26933949-619e-4d2b-a86a-094ef193d03d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.750693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1296/2563] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:27.771798 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:27.838308 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdce18-efc8-445c-a6b9-c84273e74cb3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:27.844149 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:27.844793 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.845079 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.845355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] PATH_INFO: `/v3/users/6fc145b02e904dcfba34a979bb25dc56` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.846495 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc145b02e904dcfba34a979bb25dc56)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:27.848454 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:27.902981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc145b02e904dcfba34a979bb25dc56'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.910413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc145b02e904dcfba34a979bb25dc56'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.911083 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc145b02e904dcfba34a979bb25dc56'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.911683 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc145b02e904dcfba34a979bb25dc56'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.919303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc145b02e904dcfba34a979bb25dc56'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:27.921426 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:27.941103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1268/2564] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:22:27 2022] DELETE /identity/v3/users/6fc145b02e904dcfba34a979bb25dc56 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:27.945447 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:27.946182 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:27.946453 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:27.972115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:27.972115 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:27.978468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:28.041659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1297/2565] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:28.048834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:28.050602 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:28.136221 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616fe5f-be7f-47a0-b9e7-af7c26d5275f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:28.140038 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2999e65-d3d8-4d5f-8f93-a0806278dd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:28.141144 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999e65-d3d8-4d5f-8f93-a0806278dd49 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.141422 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999e65-d3d8-4d5f-8f93-a0806278dd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.141690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2999e65-d3d8-4d5f-8f93-a0806278dd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.156421 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2999e65-d3d8-4d5f-8f93-a0806278dd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:28.158020 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2999e65-d3d8-4d5f-8f93-a0806278dd49 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:28.170794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1269/2566] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:28.537014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:28.539359 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:28.553931 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256316b-2a8b-420c-9c0a-829cf52418fd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:28.564680 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:28.565425 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.565782 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.566147 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] PATH_INFO: `/v3/projects/57eea876253e4e3ba50bde0be316eba7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.567417 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=57eea876253e4e3ba50bde0be316eba7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:28.569441 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:28.631539 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57eea876253e4e3ba50bde0be316eba7', 'request_id': 'req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:28.641134 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57eea876253e4e3ba50bde0be316eba7', 'request_id': 'req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:28.648886 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57eea876253e4e3ba50bde0be316eba7', 'request_id': 'req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:28.661168 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] The token cache is being invalidate because project 57eea876253e4e3ba50bde0be316eba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:22:28.661571 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:28.662355 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bc484e7f-ec95-46a9-b37d-0ef52e9e2eaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:28.664342 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1298/2567] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:22:28 2022] DELETE /identity/v3/projects/57eea876253e4e3ba50bde0be316eba7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:28.669195 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.669707 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.670075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.692238 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:28.693604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:28.759142 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1270/2568] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:28.767309 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.767719 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.768123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.790615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:28.792005 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:28.800842 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1299/2569] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:28.805283 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:28.816436 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85dcd3-0350-460f-b755-fc1353f14ac6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:28.820982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:28.821588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.821866 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.822135 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.822804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:22:28.823103 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:28.824717 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:28.840010 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1271/2570] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:22:28.845378 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:28.855640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af606c69-2c0e-4e84-a058-a0adc670693a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:28.861130 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:28.861743 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.862025 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.862299 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.863109 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:28.865308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:28.899893 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1300/2571] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:22:28 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:28.902504 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:28.913512 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45737999-33a1-4fb3-87fd-83ee52fc4a8a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:28.983040 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:28.984310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:28.984606 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:28.984869 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:28.985513 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:28.987570 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.012458 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1272/2572] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:22:28 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:22:29.016799 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:29.027305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c692d-342f-404d-9196-b91b4d5cc6bc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:29.033643 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:29.034384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.034739 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.035026 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.036176 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:29.037781 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.049264 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1301/2573] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:22:29.053588 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:29.072639 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:29.084804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ea447-b160-42e4-ba4e-7a6c32aefe2d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:29.091915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea10cd-cc1d-43a4-88af-6fe42101367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:29.094345 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea10cd-cc1d-43a4-88af-6fe42101367f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.094808 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea10cd-cc1d-43a4-88af-6fe42101367f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.095075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea10cd-cc1d-43a4-88af-6fe42101367f admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.095834 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea10cd-cc1d-43a4-88af-6fe42101367f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:29.098266 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea10cd-cc1d-43a4-88af-6fe42101367f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.130181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1273/2574] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:29.134533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:29.145239 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdfdf1-e328-4bdd-bc0e-4f6e3836e089 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:29.150320 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:29.150889 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.151328 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.151608 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] PATH_INFO: `/v3/projects/a4eb42a7dba14e2ab95e9f290fb165ef/users/b55f107e973343c1b6784b99b41b82e5/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.177557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4eb42a7dba14e2ab95e9f290fb165ef, user_id=b55f107e973343c1b6784b99b41b82e5, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:29.182609 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.201871 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1302/2575] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:29 2022] PUT /identity/v3/projects/a4eb42a7dba14e2ab95e9f290fb165ef/users/b55f107e973343c1b6784b99b41b82e5/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:29.212362 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.212839 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.213153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.245668 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] MFA Rules not processed for user `b55f107e973343c1b6784b99b41b82e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:29.246996 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:29.336226 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1274/2576] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:29.348636 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:29.350843 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:29.403890 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:29.447061 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17271db2-9972-4a10-910f-9aa67d2a47f9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:29.456270 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef30fe0-a9fc-441c-aaf5-24b211be3212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:29.456845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30fe0-a9fc-441c-aaf5-24b211be3212 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.457131 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30fe0-a9fc-441c-aaf5-24b211be3212 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.457412 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef30fe0-a9fc-441c-aaf5-24b211be3212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.469226 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef30fe0-a9fc-441c-aaf5-24b211be3212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:29.470939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef30fe0-a9fc-441c-aaf5-24b211be3212 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.482137 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1303/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:29.511909 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:29.603161 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88e0ac-6434-4274-bd01-c0da5159586a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:29.607671 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:29.608350 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.608670 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.608942 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] PATH_INFO: `/v3/users/b55f107e973343c1b6784b99b41b82e5` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.610075 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55f107e973343c1b6784b99b41b82e5)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:29.612042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.659999 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55f107e973343c1b6784b99b41b82e5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:29.667419 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55f107e973343c1b6784b99b41b82e5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:29.668169 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55f107e973343c1b6784b99b41b82e5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:29.668797 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55f107e973343c1b6784b99b41b82e5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:29.677481 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55f107e973343c1b6784b99b41b82e5'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:29.693814 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:29.700789 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1275/2578] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:22:29 2022] DELETE /identity/v3/users/b55f107e973343c1b6784b99b41b82e5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:29.705155 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.705765 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.705984 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.726639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:29.728136 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:29.810913 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1304/2579] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:29.822589 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:29.824060 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:29.885772 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598241-dc6d-4c76-a0f9-a763426fa56b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:29.889891 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5193a6-e95c-4d17-8d85-67c3e1a0b41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:29.891034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5193a6-e95c-4d17-8d85-67c3e1a0b41b service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:29.891309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5193a6-e95c-4d17-8d85-67c3e1a0b41b service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:29.891604 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5193a6-e95c-4d17-8d85-67c3e1a0b41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:29.901759 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5193a6-e95c-4d17-8d85-67c3e1a0b41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:29.903185 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5193a6-e95c-4d17-8d85-67c3e1a0b41b service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:29.915993 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1276/2580] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:30.209758 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.211227 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.223475 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536b29a-70f1-475a-bc07-61dc260fbf50 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.234348 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.234994 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.235305 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.235576 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] PATH_INFO: `/v3/projects/a4eb42a7dba14e2ab95e9f290fb165ef` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.236986 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4eb42a7dba14e2ab95e9f290fb165ef)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.238938 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.285437 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4eb42a7dba14e2ab95e9f290fb165ef', 'request_id': 'req-e6160277-e459-4bbe-a774-913c711eb1bf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:30.292620 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4eb42a7dba14e2ab95e9f290fb165ef', 'request_id': 'req-e6160277-e459-4bbe-a774-913c711eb1bf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:30.299246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4eb42a7dba14e2ab95e9f290fb165ef', 'request_id': 'req-e6160277-e459-4bbe-a774-913c711eb1bf'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:30.309404 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] The token cache is being invalidate because project a4eb42a7dba14e2ab95e9f290fb165ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:22:30.309693 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:30.310316 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e6160277-e459-4bbe-a774-913c711eb1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:30.312370 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1305/2581] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:22:30 2022] DELETE /identity/v3/projects/a4eb42a7dba14e2ab95e9f290fb165ef => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:30.317312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.317802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.317901 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.337005 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:30.338196 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.397193 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1277/2582] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:30.406672 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.406954 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.407223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.427399 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:30.428615 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.436339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1306/2583] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:30.440568 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.450319 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8869c4-726e-45af-8b09-9f9a678bab73 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.455131 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.455667 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.456045 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.456327 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.456974 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:22:30.457294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.458882 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.471012 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1278/2584] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 17 03:22:30.475655 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.485401 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f0592-30a3-452a-bac9-1ae87292fa8c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.490344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.490933 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.491211 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.491508 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.492198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.494120 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.520533 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1307/2585] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:22:30 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:30.524611 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.534829 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b256591-59e7-4614-a7c6-17eee2acc30f admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.573774 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.575916 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.600234 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.600954 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.601298 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.601641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.602383 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.604526 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.623346 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:30.629225 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1279/2586] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:22:30 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 17 03:22:30.632725 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.643799 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279df02-6605-4c24-815c-d826bbab3e4b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.648929 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.649605 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.649947 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.650287 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.650980 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.653336 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.662143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d6e5f-458e-4a6e-be0c-9c5508dec9d9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.664912 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1280/2587] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 17 03:22:30.666785 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.667393 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.667671 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.667987 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.669230 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.669792 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.679048 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249bc00-01c4-4aa5-a600-609f9bb0b359 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.679759 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.681245 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.684056 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f50621-2b4d-4335-b738-2813bd9fe5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.684656 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f50621-2b4d-4335-b738-2813bd9fe5dc admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.684935 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f50621-2b4d-4335-b738-2813bd9fe5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.685207 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f50621-2b4d-4335-b738-2813bd9fe5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.685845 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f50621-2b4d-4335-b738-2813bd9fe5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.688021 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f50621-2b4d-4335-b738-2813bd9fe5dc admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.690916 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:30.691583 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1308/2588] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:30.700716 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1281/2589] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:30.705288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.716383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc549ee-9cb0-40b7-a70d-42467d8909fe service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.721193 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.721845 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.722124 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.722400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] PATH_INFO: `/v3/projects/fc39751d801b4ab1bd53be6f4005797c/users/f28905fa98d24ba8a32cc6b6255cc5ef/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.737801 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc39751d801b4ab1bd53be6f4005797c, user_id=f28905fa98d24ba8a32cc6b6255cc5ef, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.741128 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.755554 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1309/2590] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:30 2022] PUT /identity/v3/projects/fc39751d801b4ab1bd53be6f4005797c/users/f28905fa98d24ba8a32cc6b6255cc5ef/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:22:30.766794 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.767148 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.767477 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.797202 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] MFA Rules not processed for user `f28905fa98d24ba8a32cc6b6255cc5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:30.798404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.867752 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1282/2591] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:30.879664 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:30.881480 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:30.940537 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e42f25-c4b0-4e0d-9257-6a3c4edd03ae admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:30.944138 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:30.944735 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:30.945014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:30.945284 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:30.955516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:30.956963 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:30.967116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1310/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:31.369095 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:31.372119 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:31.457188 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dfa184-0476-46c2-94be-fc15836572b3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:31.463311 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:31.463893 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:31.464189 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:31.464621 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:31.466342 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:31.482574 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:31.484355 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:31.496612 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1283/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:34.748570 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:34.762945 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26e7c3-b25f-430d-baab-cd9d414e9792 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:34.768910 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7b1497b5e4e4f77a92eba0c3d3b1cac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:34.769582 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:34.769873 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:34.770303 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:34.772204 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:34.785783 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:34.787721 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:34.802183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1311/2594] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:40.580358 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:40.634445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d417-119e-43af-a30f-9dadbfc7374e service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:40.639015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:40.639647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:40.639965 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:40.640244 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:40.641982 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:40.668911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:40.705091 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:40.706517 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e63668-1acb-49c3-8d72-2c6e44c1ac81 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:40.715811 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1284/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:42.481228 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:42.563564 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7ef92-6309-4f3d-8ce8-adbd39cc0c80 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:42.570014 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:42.570800 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:42.571183 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:42.571528 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] PATH_INFO: `/v3/users/f28905fa98d24ba8a32cc6b6255cc5ef` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:42.572868 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f28905fa98d24ba8a32cc6b6255cc5ef)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:42.575345 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:42.637302 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:42.649666 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f28905fa98d24ba8a32cc6b6255cc5ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:42.661288 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f28905fa98d24ba8a32cc6b6255cc5ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:42.663257 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f28905fa98d24ba8a32cc6b6255cc5ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:42.664210 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f28905fa98d24ba8a32cc6b6255cc5ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:42.678198 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f28905fa98d24ba8a32cc6b6255cc5ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:42.700647 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1312/2596] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:22:42 2022] DELETE /identity/v3/users/f28905fa98d24ba8a32cc6b6255cc5ef => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:42.704960 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:42.705475 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:42.705595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:42.727676 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:42.729015 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:42.804339 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1285/2597] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:42.816457 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:42.817904 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:42.895146 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc816ea-9a4b-455c-af00-7f83a50566d0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:42.899820 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916fe59-f64a-4151-87dc-39296852d837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:42.901602 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916fe59-f64a-4151-87dc-39296852d837 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:42.902240 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916fe59-f64a-4151-87dc-39296852d837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:42.902734 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916fe59-f64a-4151-87dc-39296852d837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:42.916436 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916fe59-f64a-4151-87dc-39296852d837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:42.919725 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916fe59-f64a-4151-87dc-39296852d837 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:42.933191 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1313/2598] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:43.420975 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:43.422908 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:43.452236 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84d882-b11a-45c9-9bc3-5f6a2e0f0760 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:43.462959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:43.462959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.462959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.462959 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] PATH_INFO: `/v3/projects/fc39751d801b4ab1bd53be6f4005797c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.472795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc39751d801b4ab1bd53be6f4005797c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:43.475210 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:43.531911 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc39751d801b4ab1bd53be6f4005797c', 'request_id': 'req-e46c9db6-b7fe-404b-8a59-235e03601376'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:43.540722 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc39751d801b4ab1bd53be6f4005797c', 'request_id': 'req-e46c9db6-b7fe-404b-8a59-235e03601376'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:43.548028 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc39751d801b4ab1bd53be6f4005797c', 'request_id': 'req-e46c9db6-b7fe-404b-8a59-235e03601376'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:43.561867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] The token cache is being invalidate because project fc39751d801b4ab1bd53be6f4005797c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:22:43.562294 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:43.563077 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e46c9db6-b7fe-404b-8a59-235e03601376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:43.565275 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1286/2599] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:22:43 2022] DELETE /identity/v3/projects/fc39751d801b4ab1bd53be6f4005797c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:43.570556 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.571013 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.571123 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.592385 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:43.594097 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:43.673327 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1314/2600] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:43.680987 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.681158 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.681411 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.722309 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:43.723652 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:43.736740 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1287/2601] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:43.740468 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:43.758043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4d7a3-23a3-4748-9f98-79c9c73a6a5f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:43.766400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:43.767021 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.767310 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.767587 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.768268 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 17 03:22:43.768578 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:43.770266 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:43.784610 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1315/2602] 10.222.0.20 () {58 vars in 1153 bytes} [Mon Oct 17 03:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 17 03:22:43.789438 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:43.800585 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89016c81-d21c-4622-a7ce-e411edb14032 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:43.805684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:43.806599 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.806883 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.807155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.807804 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:43.809881 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:43.841340 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1288/2603] 10.222.0.20 () {60 vars in 1153 bytes} [Mon Oct 17 03:22:43 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:43.846769 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:43.859482 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287571d0-5ccf-4927-abb5-10e53da8ee31 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:43.911503 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:43.927246 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:43.927859 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.928207 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.928484 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.929237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:43.931160 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:43.953961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1316/2604] 10.222.0.20 () {60 vars in 1144 bytes} [Mon Oct 17 03:22:43 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 17 03:22:43.958181 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:43.970099 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e509-ed06-472a-9e60-653765e7a426 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:43.975190 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:43.975796 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:43.976110 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:43.976379 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:43.977014 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:43.978785 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:43.988863 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1289/2605] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:43.994593 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:44.005400 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c1725-2cfa-497d-88ed-733ff1f1edb0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:44.010121 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8cbf1-bf7a-4c61-ac5f-d75ee2cbfd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:44.010723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8cbf1-bf7a-4c61-ac5f-d75ee2cbfd38 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:44.011007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8cbf1-bf7a-4c61-ac5f-d75ee2cbfd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:44.011281 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8cbf1-bf7a-4c61-ac5f-d75ee2cbfd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:44.011956 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8cbf1-bf7a-4c61-ac5f-d75ee2cbfd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:44.013557 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8cbf1-bf7a-4c61-ac5f-d75ee2cbfd38 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:44.025203 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1317/2606] 10.222.0.20 () {58 vars in 1122 bytes} [Mon Oct 17 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 17 03:22:44.029034 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:44.039442 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d751ca2-f517-412c-9b86-f4dcda9031f4 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:44.044264 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:44.044915 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:44.045194 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:44.045462 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] PATH_INFO: `/v3/projects/347ce321af414a81a28d7a4b1d1bcac4/users/f29cd47f483943f6b81a91bbb393561c/roles/ab9c3b4062604fe89c73ebd5acc431c7` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:44.047928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:44.064595 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347ce321af414a81a28d7a4b1d1bcac4, user_id=f29cd47f483943f6b81a91bbb393561c, role_id=ab9c3b4062604fe89c73ebd5acc431c7)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:44.067200 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:44.081867 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1290/2607] 10.222.0.20 () {60 vars in 1483 bytes} [Mon Oct 17 03:22:44 2022] PUT /identity/v3/projects/347ce321af414a81a28d7a4b1d1bcac4/users/f29cd47f483943f6b81a91bbb393561c/roles/ab9c3b4062604fe89c73ebd5acc431c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:44.094116 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:44.094362 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:44.094639 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:44.122382 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] MFA Rules not processed for user `f29cd47f483943f6b81a91bbb393561c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:44.124167 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:44.190357 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1318/2608] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 17 03:22:44.200981 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:44.203413 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:44.292018 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982ccd7-fbac-4062-ba3f-8b6e6a91c831 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:44.296485 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7cc51-25b7-4df0-b0ac-6847b08795d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb1916e113843f6a02c8b80c33b1532', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:44.297096 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7cc51-25b7-4df0-b0ac-6847b08795d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:44.297371 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7cc51-25b7-4df0-b0ac-6847b08795d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:44.297641 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7cc51-25b7-4df0-b0ac-6847b08795d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:44.307674 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7cc51-25b7-4df0-b0ac-6847b08795d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:44.309353 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7cc51-25b7-4df0-b0ac-6847b08795d8 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:44.320239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1291/2609] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:47.391577 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:47.452740 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193090f-a998-4a11-97d0-01f48f3c0e8c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:47.457143 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:47.457751 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:47.458033 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:47.458301 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] PATH_INFO: `/v3/users/f29cd47f483943f6b81a91bbb393561c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:47.459422 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29cd47f483943f6b81a91bbb393561c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:47.461344 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:47.505973 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29cd47f483943f6b81a91bbb393561c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:47.512692 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29cd47f483943f6b81a91bbb393561c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:47.513340 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29cd47f483943f6b81a91bbb393561c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:47.514440 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29cd47f483943f6b81a91bbb393561c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:47.516119 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:47.523007 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29cd47f483943f6b81a91bbb393561c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:47.541597 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1319/2610] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:22:47 2022] DELETE /identity/v3/users/f29cd47f483943f6b81a91bbb393561c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:22:47.546310 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:47.546783 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:47.546899 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:47.566050 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] MFA Rules not processed for user `b3a2e1a16eeb43688a0405b1a0339b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:22:47.567248 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:47.624942 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1292/2611] 10.222.0.20 () {58 vars in 958 bytes} [Mon Oct 17 03:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:22:47.634429 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:47.635819 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:47.691125 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc717-da1c-4b4b-ac26-e0c396e6b6fd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:47.694730 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5aaa15-182c-4167-9831-9b4da8f9c7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '315ab129549044d2bce148bb55dc63ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:47.695322 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aaa15-182c-4167-9831-9b4da8f9c7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:47.695600 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aaa15-182c-4167-9831-9b4da8f9c7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:47.695885 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aaa15-182c-4167-9831-9b4da8f9c7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:47.705723 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5aaa15-182c-4167-9831-9b4da8f9c7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:47.707141 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5aaa15-182c-4167-9831-9b4da8f9c7a3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:47.716461 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1320/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:22:47.975802 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:22:47.977377 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:22:47.990516 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018ea2-e0e7-45a6-89c8-d9744a24b495 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:22:47.995430 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:22:47.996292 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:22:47.996571 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:22:47.996842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] PATH_INFO: `/v3/projects/347ce321af414a81a28d7a4b1d1bcac4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:22:47.999155 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=347ce321af414a81a28d7a4b1d1bcac4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:22:48.001081 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:22:48.048145 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347ce321af414a81a28d7a4b1d1bcac4', 'request_id': 'req-e6364a8c-b9bd-49f8-8d41-fea483fa4484'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:48.055480 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347ce321af414a81a28d7a4b1d1bcac4', 'request_id': 'req-e6364a8c-b9bd-49f8-8d41-fea483fa4484'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:48.061838 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347ce321af414a81a28d7a4b1d1bcac4', 'request_id': 'req-e6364a8c-b9bd-49f8-8d41-fea483fa4484'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:48.071921 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] The token cache is being invalidate because project 347ce321af414a81a28d7a4b1d1bcac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:22:48.072216 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:48.072842 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:22:48.074304 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1293/2613] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:22:47 2022] DELETE /identity/v3/projects/347ce321af414a81a28d7a4b1d1bcac4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 17 03:22:57.712308 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=34 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:22:58.068933 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:06.910924 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:06.911408 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:06.911516 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:06.930835 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] MFA Rules not processed for user `6160cbf6da6840babe24c6252b069d73`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 17 03:24:06.932080 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:06.985923 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1321/2614] 10.222.0.20 () {58 vars in 967 bytes} [Mon Oct 17 03:24:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 17 03:24:07.026625 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:24:07.028069 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:07.096303 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6364a8c-b9bd-49f8-8d41-fea483fa4484 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:24:07.101664 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1d31c2fdfe467ebbed5a3a46ab4325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:24:07.102538 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:07.103070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:07.103357 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:07.112479 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:24:07.114141 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:24:07.122472 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1294/2615] 10.222.0.20 () {60 vars in 1384 bytes} [Mon Oct 17 03:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 17 03:24:10.235451 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:24:10.236977 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:10.320569 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1403502-6b0d-41b3-8f60-2406b6e36607 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:24:10.326939 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:24:10.327773 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:10.328102 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:10.328383 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:10.331101 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:10.347223 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:24:10.349627 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:24:10.362339 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1322/2616] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:24:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:24:13.454109 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:24:13.455704 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:13.531265 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d0d31-41da-4ffc-8559-8730ab091927 service swift] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:24:13.535836 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:24:13.536478 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:13.536760 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:13.537035 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] PATH_INFO: `/v3/users/e5885ed3727047a19a49bb930daf9d28` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:13.538139 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5885ed3727047a19a49bb930daf9d28)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:24:13.540337 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:24:13.588445 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5885ed3727047a19a49bb930daf9d28'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.595635 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5885ed3727047a19a49bb930daf9d28'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.596404 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5885ed3727047a19a49bb930daf9d28'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.597094 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5885ed3727047a19a49bb930daf9d28'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.606391 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5885ed3727047a19a49bb930daf9d28'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.629473 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1295/2617] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:24:13 2022] DELETE /identity/v3/users/e5885ed3727047a19a49bb930daf9d28 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:24:13.799390 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:24:13.812043 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6374c-b410-4813-87d4-2e7d9d3b651b service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:24:13.868803 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:24:13.869397 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:13.869686 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:13.869961 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] PATH_INFO: `/v3/projects/b9a3e539493e450ba8dd41d029e8dab5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:13.871073 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a3e539493e450ba8dd41d029e8dab5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:24:13.873118 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:24:13.909450 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:13.918716 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a3e539493e450ba8dd41d029e8dab5', 'request_id': 'req-1a10b144-cc7a-4d4e-a6be-4e286e412db1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.926256 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a3e539493e450ba8dd41d029e8dab5', 'request_id': 'req-1a10b144-cc7a-4d4e-a6be-4e286e412db1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.932388 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a3e539493e450ba8dd41d029e8dab5', 'request_id': 'req-1a10b144-cc7a-4d4e-a6be-4e286e412db1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.942623 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] The token cache is being invalidate because project b9a3e539493e450ba8dd41d029e8dab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:24:13.943017 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.943640 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:13.945159 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1323/2618] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:24:13 2022] DELETE /identity/v3/projects/b9a3e539493e450ba8dd41d029e8dab5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:24:13.949235 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:24:13.950666 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:13.963684 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5c849-dca4-4e6f-8421-ff1860eb303a admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:24:13.968245 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:14.020412 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:24:14.021042 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:14.021323 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:14.021594 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] PATH_INFO: `/v3/users/b1c5d9729f6346b3a4f923ec8f8ee769` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:14.022702 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c5d9729f6346b3a4f923ec8f8ee769)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:24:14.024647 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:24:14.068667 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c5d9729f6346b3a4f923ec8f8ee769'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.075384 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c5d9729f6346b3a4f923ec8f8ee769'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.076070 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c5d9729f6346b3a4f923ec8f8ee769'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.076688 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c5d9729f6346b3a4f923ec8f8ee769'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.083659 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c5d9729f6346b3a4f923ec8f8ee769'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.101239 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1296/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Mon Oct 17 03:24:13 2022] DELETE /identity/v3/users/b1c5d9729f6346b3a4f923ec8f8ee769 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:24:14.267567 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:24:14.269018 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:24:14.283948 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10b144-cc7a-4d4e-a6be-4e286e412db1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:24:14.341360 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3a2e1a16eeb43688a0405b1a0339b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ee3c4f2dfdc417cadc7f4d4979df81a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:24:14.341991 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:24:14.342272 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:24:14.342548 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] PATH_INFO: `/v3/projects/1590bce2a4c74f738fbecdfd3b062766` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:24:14.343659 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1590bce2a4c74f738fbecdfd3b062766)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:24:14.346154 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:24:14.390367 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1590bce2a4c74f738fbecdfd3b062766', 'request_id': 'req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.397384 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1590bce2a4c74f738fbecdfd3b062766', 'request_id': 'req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.403495 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1590bce2a4c74f738fbecdfd3b062766', 'request_id': 'req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.414292 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] The token cache is being invalidate because project 1590bce2a4c74f738fbecdfd3b062766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 17 03:24:14.414585 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.415216 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-10096fe9-cdbd-4fb2-bf72-c93c59b4f6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 17 03:24:14.416711 dv-cinder-846977-2-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1324/2620] 10.222.0.20 () {58 vars in 1233 bytes} [Mon Oct 17 03:24:14 2022] DELETE /identity/v3/projects/1590bce2a4c74f738fbecdfd3b062766 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 17 03:24:24.097795 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:24:24.411237 dv-cinder-846977-2-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 03:25:00.389153 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 17 03:25:00.390541 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:25:00.459548 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d0c9d-74fa-4abe-9c2f-2ae04ebd5dca admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 17 03:25:00.520066 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2e2fbc7539a421f909f96d224953867', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed6b8d86d65341cfa9ae8ad5923e975e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 17 03:25:00.520690 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 17 03:25:00.520967 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 17 03:25:00.521237 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 17 03:25:00.522985 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 17 03:25:00.534312 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 17 03:25:00.535928 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50571df-5499-4ddf-8898-fb40494c83ed service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 17 03:25:00.545619 dv-cinder-846977-2-smb devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1297/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Mon Oct 17 03:25:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 17 03:25:10.541389 dv-cinder-846977-2-smb devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=58 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}